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ABSTBACT 

This volume describes the precess, findings , and 
implications of a complex research project known as the Beginning 
Teacher ivaluation Study (BTIS), 1 major contributign of the study is 
its focue on academic learning Tine (ALT) as a measure of learning* 
ALT is the asount of time a student spends engaged in academic tasks 
of appropriate difficulty* The study began as a search for 
information on irhich te base policy decisions regarding desirable 
ccmpetencles for beginning teachers* for a variety of reasons the 
studi began to focus on second- and fifth^grade mathematics and 
reading and on experienced ^ rather than beginning, teachers* The book 
is divided into three parts with Itt chapters, each by a different 
author or group of authors* The first describes and analyses the 
findings of the study and connects thei to a groving body of 
literature on the importance of time as a key Influence on learning. 
The second explores nhat the study might mean to teacher educators, 
ataff developers, teachers, and principals* The third section moves 
the research findings into the schools i a teacher and a principal 
describe how they use the findings* In addition, policy-making and 
dissenination are discussed as two essential concerns of large-scale 
research on teaching and learning, such as the BTIS^ (Author/MLFI 



* Beproductions supplied by EDIS are the best that can be made * 

* from the original document* * 

ERLC 



U S DEPARTMf NTOF MiaLTM. 
iSUCATiON ft WlLFARt 
N&TIONAL INSTITUTE QF 
eOUC^TION 

THIS BQCUMCNT HAS SEEN REPRQ- 
DUCEP EXACTLY AS RfiCErVED FROM 
THE PERSON Om ORG^NiZaTrON QRIGIN- 
ATiNG rT FOrNTS OF VIEW OR QPlNrONS 
STATED 00 NOT NECiSS&RlLY ^epre^ 
SiNTOPPJCt^L NATIONAL INSTITUTSOF 
IDUCATlON POSiTrON OR PQLfCV 



TIME TO LEARN 

Carolyn Denham and Ann Lieberman 

Co-Editors 

California Commission for 
Teacher Preparation and Licensing 



A review of the Beginning Teacher 
Evaluation SUidy, conducted with funds 
provided by the National Institute 
of Education 



U.S. Dapartment of Education 
Shirley M, Hufitadlerj Sicritiry 

Natf oiial Institute of Eduction 

Michiil TimpEne, Director 

ftogram on Taachin| and Leanilng 
Lois-elUn Ditta, Associite jMreetor 



May 1980 



0>iic^.inns axpreisad in this vdum.? tfc thorn of the a^^thora 
a'^id do ml lifteassarQy reileci the podtiDn or poUey of the 
Nafi.onal ImiiUut of Education or the CalifprTUa Commis- 
^on for Taagher Preparation and Uceniing, 



3 



Introductory Note 



This volume describes the prosess, findinps and implicitions of a com- 
plfx imBBTch pTojmt known as thg Bf^ning Teacher Evaluatign Study 
^TES). The 6-ygar study was fundad by the Nation^ Institute of Educa* 
tion throu^ the Cdlfbmia COTimisilon for Teacher Priparation and 
liceiising^ 

A major contribution of the study is its focus on Academic Learning 
Tune (ALT) as a miasure of leamifig. ALT is the irnount of time a student 
spends engaged in iwadeniic taste of appropriate difficulty. It is not sur- 
priMn^ perhaps, that the study found ALT related to student achieve- 
ment. But on visits to claMrooms one is likely to see students spending 
large amounts of time not enppd in learning. 

The notion tiiiat students should be observed to see how much time they 
spend learning is an idea perhaps neglected by teachers or by those who 
evaluate or comment on teaching. The BTES research implies that it is not 
only possible but also important to look at Academic Learning Time. A 
teacher who observes his or her own classroom with ALT in mind may see 
new solutions to teaching problems. Wien edu^tiond questions such as 
group versus infividual instruction are considered in li^t of ALT, new 
perspectives may emerge. TTus book explores these and other implications 
of the Bepnmng Teacher Evaluation Study. 

The study began as a search for infonnation on which to base policy 
decisions reprding desirable competencies for beginning tiachers. Al- 
though the initial title for the study wa^ retained^ early stages of the effort 
revealed that attempting to identify a single set of competencies for all 
beginning teachere was m inappropriate task* Early research results 
pointed to the need for a better understandini of the nature of instnsction 
and effective teaching practices as they related to sp^iflc pades and spe- 
cific subject matter. For a variety of reasons the study bepn to focus on 
second* and flfth-grade mathematics and reading and on experienced, 
rather than be^nning, teacher. As a result^ the study provides perhaps the 
most comprehensive effort to date describing teaching and learning in 
these pade and subject levels. 

The BTES did not^ nor was it intended to^ provide "ma^c answers'' 
about how to improve the nature of education. It did not address pade 
levels or subject areas other than those mentioned above, Althou^ there 
are apuficant contributions of the study ^ such as tiie concept of Academic 
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Learning Time, no prescriptions for successful teaching are intended. Per- 
haps the greatest BTES contribution may be that it reveals a much clearer 
picture of instruction and its consequences than was available heretofore. 
Thus, it provides a better basis on which teachers* administrators, re- 
searchers, teacher educators, and others can make decisions re|arding their 
practices and poUcies. 

The book is divided into three parts. The first describes and analyzes 
the findings of the study and connects them to a growing body of litera- 
ture on the importance of time as a key influence on learning. The second 
explores what the study might mean to teacher educators, staff developers, 
teachers, and principals. The third section moves the research findinp into 
the schocls; a teacher and a principal describe how they use the findings. 
In addition, policymaking and dissemination are discussed as two essential 
concerns of large-scale research on teaching and leaming, such as the 
BTES. 

Marjorie Powell, former coordinator of the study for the California 
Commission for Teacher Preparation and Licensing, gives a brief history of 
the project, 

Charles Fishen David Berliner, and their colleagues at Far West Re- 
^onal laboratory for Educational Research and Development summarize 
their research rindings. The Far West Laburatory buUt on the work of the 
Educational Testing Service in the early stages of BTES and was responsi- 
ble for the conduct of research activities over the last 4 years of the 
project, 

Walter Borg, Utah State University, reviews the literature on time arid 
learning. He shows how BTES makes a unique contribution to research on 
allocated time and time-on-task and how it builds on the theoretical work 
of Carroll, Bloom, and Wiley and Harnischfeger, 

nomas Romberg, University of Wisconsin, first explains how the Aca- 
demic Uaming Time model represents an advance in thinking about teach- 
ing and leaming and then discusses the limitations of the model He con- 
cludes with an analysis of implications of the study for researchers, practi' 
tioners, and policymakers. 

Jmtes Block, University of California, Santa Barbara, argues that one of 
the most promising aspects of the study is its emphasis on academic tasks 
the student can perform with success. Block relates BTES findings to 
Benjamin Bloom's mastery leaming theoty. 

Bamk Rosenshine, University of Illinois, analyzes BTES data related to 
time and considers ways to restructure use of time in schools to improve 
instruction. He discusses the difficulties of making changes in use of time 
in schools. 

GaFy D. Fenstermacher, Virginia Polytechnic Institute, argues that 
brid^ng the gap between research and practice by making rules-such as a 
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mle that itudfnti inpge in a ^vin mount of ALT-is dfbil' 
l^di to misuse of the study's flndin|S. Ha maintains that it 
bridge the pp by providing pmctitioneii ^dth a way to s' 
e^ariances and oteamtionsp 

Km^n 51 Kepkr^ T^chajre Collegi, Columbia, offers a educa- 
tion pe^pactive on the weaJmessei and strengths of tlie She dis- 
cuss limitations in its direct ai^Ueabflity to preservice te ucation 
but dso examine its confribution as a framework fo ^ ng pre= 
service eduaation p^tia^, 

Lynn MUier^ Northwestern Univemty, sees BTES as s through 
vMch to view actintiei of teachers and students. She beUe ^[1 
development should be a nonpre^riptlve process in -^hich t i 
active participants in thfir own professional developr mt. Si 
the potential and limitations of BTES as one tool for sta ^ davel m. 

RkharH C WUimms^ U[iivfrsity of CaUfomiai Leg A^igeleSi ^ ^ i 
the fol<! of the principd in implamentation of new pntctices faa:i jn 
BTES ^^arclu Many of his suggestions are based on tw lajor stui of 
mnovation: the I/D/E/A Study of Educational Changes j 1 Sc?\uoi Iin- 
provement and the RAND Coloration Study of Federal Programs Sop- 
porting Edueadonal Change, 

M Fnimes Kiein^ Pepperdjne University, briefly reviews various cunfc- 
ulum theories and describes BTOS as an element of one or more curricu- 
lim a^roaches. 

Raque! Muir a sixth-pade teacher in &nta Monica, Cdifomias reports 
on 3 years experience udng WTEB ideis in her sixth-pade classroom. Sie 
qieaks of BTES ccncepts as tools that can be used by teachen vdth a 
variety of taacWni styles, 

Pmmla H Noh\ an elementary school principal in Madera, California, 
^res what Ae has learned from attempts to encourap teachers to in- 
crease students' timMn-taslc She stresses the need for collaborative deci- 
domnaldng and the naed to addre^ the trauma aMOciated vwth implement- 
ing innovations such as BTES-based instructional chanps. 

Ann Lkbemmn^ Teachers CoUege, Columbia Univemty, discuses the 
difficulties of joining topther the worlds of the researcher and practi- 
tioner. She su^sts that a dialofue between practitioner and researcher 
replace the more common practice of one-way dissemination. 

Qsrolyn Denlmn^ C^fomia State University, Long Beachj su^ests how 
the flndinp mi^t be conadered by the CaUfomia CommiMion for 
Teacher Preparation and licensing md other poUcymaMng bodies such as 
le^latures and school boards. She also describes policies that would be, in 
her opinion^ misuses of the research. 
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In a long-tenn project m complix as this om, scores of people made 
contributionSi Wf cannQt attempt to aclmowledge ^ the many contribu- 
tor to the project. We are especiaDy aware that ^thout the participation 
of many studenti, teachar, princip^, and adviserSi such a study could not 
have been accompUihed. 

Both the Educational Testing &rvlce and the Far West Labomtory for 
Educational Research and Development exhibited tremendous research ex- 
pertise and practice indghts in the research and dissemination phases. 
Joseph Vau^anp NIE Pro^ct Officer, encouraged and nurtured not only 
the reseafch but dso the d^semination phase. 

Peter LoPresti, Executive Se^retaty of the California Commission for 
Teacher Preparation ^d Licer^ingi has been continu^y supportive of the 
unique collaboration betwean a State agency and a research organization. 

TOe Commission for Teacher Preparation and licensing as a whole has 
been actively involved throu^out this study. They are to be commended 
for their efforts to support and maintain collaboration among aU 
participants. 

AU aspects of the study are described in more detafl in technical 
reports, and selected aspects of the research are described in a series of 
newsletters'. Material relatin| to this study can be obtained from the 
following address: 

BTES 

Comnussion for Teacher Preparation and Licensing 
1020 **0** Street 
Sacramento, CaUfomla 95814 

Most of Mb material is avaflable wthout cost, 

Cmlyn Dmhmn and Ann Liebmmn 
Co^Editors 
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The Beginning Teacher 
Evaluation Study* A Brief 
History of a Major 
Research Project 

Mcaione Powell 

Tht CMifomii Commlsiion for Taicher Preparation Licenang 
(CTPL), establishid in 1970i is responsible for issuing and revoldng teich- 
ing credintiaU and appro^g progrms of teacher education. ITie IS vot- 
uig memberSg appointed by the govemorj are school tewhars, faculty of 
Mgher education institutions^ school board niemberSj and pri>^te citizens. 
Five m offldo member are appointed by five State education agencies. 

Within le^lative constraintij CTPL is also reiponiible for eitabUshing 
standards both for issuaiinp of credentials and for approval of teacher 
education pfograms* limited re^arch on teaching, competing philQsopW- 
cal statements about important teaching sidls, the need to find justifica- 
tion for the standards adopted^ and the powing interest in the 
competency-basad teacher education movement led CTPI^ shortly after its 
formation, to undertake a research effort to identify teadier competencies. 

An initial planning pant \^s obtained from the U.S. Office of Eco- 
nomic Opportunity to identify teacher competencies in the teaching of 
rea^gp After die establishment of the National Institute of Education in 
1972 as the Pederml agency responsible for educational research and devel- 
opment, Ending for the research was moved to NIE. 

Goals 

Initially, a study planned to fulffll two purposes smiultaneoudy^ 
the identifl^tion of generic teacher competencies and the evaluation of 
teacher education pro^mms throu^ foUowup of graduates of those pro^ 
grams. Hie intended focus on recent paduates of teacher education pro- 
pams resulted in the name of the research effort, the Beginning Teacher 
Evduaiion Study (BTES). 
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As the resiireh propiissdj the goals changed, TTii work of an early 
planning confarenee eon\dneed CITL to leave program evaluation to 
another effort and to focus on identifying and describing teaching skills 
and their impact on student outcomsi. By the third year of the fieldwork, 
ihe focus on identification of teaching skills was expanded to include 
other goals: fostering research on teaching mi teacher education, enhaic- 
ing communication between researchers and educators, and modeling 
effective interagency cooperation. Althou^ the focuses on both evalU' 
ation and, later* be^nningreacheri were dropped, the title of BTES was 
retained. 



Planning the Research— 1972-73 

Early decisions influenced, directly and indirectlyi both the desigri of 
the research and the administration under which the research occurred. 
The commission staff mitiaUy developed a research plan that was reviewed 
by researchers^ school district personnel, teacher educators, and members 
of several educational organizations, Hiey surest ed major revisions in the 
plan. 

Next, a contractor developed a revised plan, incorporating recom- 
mendations from the plannmg conference group and additional changes. 
The contractor recommended that the research focus on ^ades two and 
five, to provide some information about whether the teacher sldlls were 
equdly important at those two grade levels. To make it possible to general- 
ise the results further acro^ teachtog situations^ the contractor also recom- 
mended Uiat the study consider the teaching of mathematics as well as 
reading. These four areaSj reading and mathemati^ at grades two and five, 
remained the focus of the research effort throu^out the study. The oon- 
tractor's research plan called for an initial year of fleldwork to identiftr 
teacher sldlls using a sample of experienced teachers, and to validate the 
list of sldlls with a second sample of experienced teachers. A sample of 
be^nning teachers was to provide information about realistic entry levels 
in the identified teaching sldlls. 

Administmtive decisions made at this time also influenced the structure 
of the re^arch system throu^out the study* The CTPL members decided 
to select contractors (through a request-for-proposals process) to conduct 
the research^ rather than establish their om. research staff. A research 
advisory board was to provide advice about research decisions before they 
were made, while a second contractor wai to conduct a propam audit of 
the activities of each major research contractor. 
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Iniflil Fieldwork-1973'74 



Ihi Edticationd Testing Ser^ee ^TS) of Princeton, New Jf ney, got- 
ducttd first yw of fiildwork. Data coUaetion covirid flv€ major 
iriai* studint achieveinint in and attitude toward rtading and matha^ 
inatiai; student baekpound and charaaterisdci; tiaahir background ^d 
^araetiristi^^ deluding taa^tr verbal biha^or; s^ool baal^Qund and 
charaetiriftiQi, ineluding s^ool olimati and support services; ^d teaoh@r 
biha^ors i^^in tiit olamoom^ A i^pla of 93 ttaehe^ was obsirvid 
froin two to id^t tisnm mth tw^ obifmdon i^rtiniBi and da^is war@ 
^diOtaped during rii^Lg mathemstioi inatruction. hformation about 
teaoh@r and student baol^^und^ ttaohir didsiomn^dng prooeises^ school 
climatic and p^gmn siqpport was^oQictyd, and studint ichiivemfnt and 
attitude were measured ui the faU md spiing. 

In 1973*74 CTPL convtned the rasctich advfeoiy boards compo^d of 
laa(Ung researcheis and practitione]^ in C^fomia md from other areas of 
tha count^« Soma mambars of the bo^d ware retdned throu^out the 
study to provide Mstorieal patipactlva mi axtansl^ loiowladge of the 
re^arch; new member rotatad into tha board mtik additional peBpeotivas 
and frash idaas, Tha CIPL^ ratainfaig Its autfiority for aU major decisions 
on the nature of the study whila saekbig to obtain a ruiga of arginnants 
for and against any action^ sought ad^ce from each member of tha boards 
fa^ar ihm unanimous racommendations^about research plans, data col^ 
lection, instrummts^ and interim and fmal reports. The process of board 
ravkwi althou^ seen as a^entials dldp however^ add contldarabty to the 
lima necessary to complete any step of the research mi had to be coniid- 
arid in davaloping time schedidas* 

A ^parate propam au^t firm coUected infomiation and subirUtted 
liports that providad CIPL and with an additional perspective on the 
research effort, one Aat a^esied cmipleted portions of tha rasaaroh activi* 
tias« "Hie review mechanism pro^dad a tool for future deciilonmtddng in 
the projects 

Addirtonal Fieldwork- 19 74-76 

The 1973-74 reiearch was devalued from a traditional idew of teach- 
ing, incorporating measures of teacher diaractaristici and baha^ois from 
pra^ous resaarch and from educational p^cholo^. With re^areh ad^ory 
board encourapment, another ye^ of flaldwork ms planned durbig 
which difTarant parspactives on teaclung would be used to identify addi^ 
tionM ^tables for study. Witii approvd of the revised schedtde, 
CI7L salectad the Far West Repond Laboratory for Educational Research 
and Development (FWL) in San Fr^cisco, Cdifomia, to conduct this 
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resa^ch to idantify othir unportint teaching 'mriablas and to vaUdats the 
nature of tha teaching skills ilraady daflned, Ihis flaldwork also sub^ 
Ject to a propam audit. From that pointt FWL conduQtad afl rasaafalu 

During the 1974-75 work, a voluntaar sampla of 200 taadia^, 100 in 
each of ^dai two and flva» tau^t 2-week umts in reading and mithe- 
nmtics. Uiing the data on teacher beha^^or and on student achiavamant on 
the unit content as a ^ida, a sample of 40 taachars was identifled^ 10 
teachers at each ^da level ware considered to be mora effective in teach- 
ing the uiuti and 10 at each pade levd ware considered less effective. 
Thasa 40 teachers then participated in three special studiai. In one study, 
trained ethnogiapheri spent a weak In each ala^room racordmg their ob- 
servations, "nia second study, concerned ^th teadiar plmning and de- 
cisionmaking for and during instruction, pve taadiers the simulated task 
of planning for a yev of instruction for a sample of students, ^ay were 
^o asked to watch a ^deotape of one of their own lessors and to recall 
and discuss the decisions they had made during the mstruction. In ^e 
third study, teacher and students ^tchad ^deotapes of different teach- 
ing styles and identified unportant aspects of teaching. 

During 1974-75| a pflot study ym% recommended to clarify a inajor 
concept emer^g from the re^arch: instructional time. The research staff 
also recommended additional work to develop (1) tests of student achieve- 
ment that were more sensitive to ttie instruction, and (2) simpler and more 
accurate Instruments for coUacting time information from teachexi. The 
CITL members, the research ad^soiy board, and NIE agraad to revise the 
research ^hedule once mora. A small study of time concepts and data 
coUection procaduras and a revision of the student adiievament tests were 
complatad during the 1975-76 school year ^th a sample of 30 teachers in 
grades two and five. 

Final Field Study^ 1976-^78 

Hans for a flald study ware than developed from the work of the Far 
West Laboratory and ETS and from a review of other recant rasaarch. 
Several research flndlngs pointed to a naad for intansive observation m a 
smaller sample of classrooms than had originidly been plaimed. l^e final 
fidd study involved a^roximately 25 tethers in eadi of grades two md 
five. Data coUection occurred during the 1976-77 sdiool year, and data 
an^ysis the foUovtdng year. 

hi each classroom, six students who were dmUar in entering achiavi- 
m^t ware selected. These students completed acMevemant tests and atti- 
tude measiires in October, Decamber, May, md the follomng faU. Between 
tests the teai^ers nmintainad records of time allocations- and diffic^ty 
level of reading and mathematics t^ks and also reported on their planning 



15' 



Maqorie Powell 



in wieWy tatindewi. Weekly obiarvitions focusid on time allocation, 
student engapment on tasta, task difficulty^ and teadier beha^ors di- 
rected to the observed students* Each of these variables is defined and 
discussid in liter chaptei^, 

. ^ese data eoUection activities risulted in a comprehensive data base to 
be andyzad and a complex set of intcnelated d^Moni about data and- 
yds. To pronde CTPL with ad^cc about tiii appropriatiness and feasi- 
bflity of the data msiym^ a subpoup of the researdi ad^soiy board 
reviewed in peat depA the ^sdts of completed andysei and the plans for 
future andyses. On the basis of this thorou^ consideration of alternatives 
from a variety of perspeotiws, the data ^alyses were done. 

msstmlnation 

During the first seveml yeiii of the study, CTPL provided information 
about the study primarily through publication of the jBTBS Report ^ de- 
signed to provide executive summaries of the various technical reports 
submitted as part of the researdi effort* Mid the BTES Nm^slett^r^ de- 
iipied to communicate future research plans and discuii research results 
with a range of audiences. Staff members of CTPLi EIS, and the Far West 
Laboratoiy made presentations about the study to a variety of ojEgMiiza- 
tions ^thin California and at nationd profession^ meetings^ 

Aldiou^ several alternatives for find re^ew of research results and 
appropriate disseniination plans had been discussed periodically, formal 
planning for dissemination efforts began with the convening in 1976 of a 
research utiUEation board composed of school penonnel^ teaser edu- 
cators^ and researchers, B^ed on their recommendations, CITL staff de- 
veloped a dissernlnation plan for the 1978-79 and 1979-80 school yeai^* 
'Die dissemination acti^1ties will involve members of the tarpt audiences— 
teacher educator and school personnel-in consideration of the 
implications of the resear^ results for teadier education and for teaching. 
In addition^ a. minlgrants program was implemented in the summer of 
1979 to provide support for a diversity of practitioners who wish to 
attempt initructional changes based on flndings of BTES^ 

iythou^ goals, time sdiedules^ and i^search plans have evolved and 
changed over the several yem of the research effort^ tfie study has iden- 
tified a number of important aspects of teachings h^ influenced and de- 
¥iloped new and more comprehensive means of investigating teachers' 
effectiveness, and has demonstrated tlmt a State policymaking agency , a 
Federal education agency, researchers, and practitioner can productively 
engage in research on instruction as a process for prEctice, research, and 
educational policy decisions. 

^e remaining chapters of this book present a diversity of piiipictivei 
and opinions on the BTES and its implications* 
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Teaching Behaviors^ 
Academic Learning Time^ 
and Student Achievement 
An Overview 

Charles Fisher, David C Beriiner , Nikola K Filby, 
Richard Marltave, Leonard Cahen, and Marilyn M Dishm 

The purpose of thi Banning Tischer Evduation Study^ (BTES) was 
to idindfy tiiching aetivities and cla^raom conditions that fostir student 
laarning in elam^ntary sohools^ The study focused on instruction in 
raading and maUiematics at padai two and flve« During tiie multlycar 
series of substudiis comprising BTES, a variety of issues was addrassed; 
data from seveml samples of teachers and stu dints were coUectad and 
an^yzad. Dapanding on die question being asked, various data coUection. 
techniques were used, including e^ographyt stimulated recdl, interviewSi 
teacher and student self-report, objectiva observation, and testing. As the 
study progre^d, a modd of cla^room instruction and student learning 
evolved and provided ^e conceptual framework that guided the final em- 
piricd stap of &e study. The development of the model is in itself one of 
tfia mort important outgomai of the study* 

TUb summary chapter^ presents (1) a brief d^cription of the model as 
it applies to the acquisition of raading and mathematics skills in aleman- 
taiy schools; (2) an overview of the metiiods used In the final field study; 
(3) die major flndinp of the study; and (4) some implications of the study 
for the practice of teaching. 



i Althou^ ttt title of tiia ovmU femroh papain ip^lfles "banning" teashirs, 
it b bnpertatit to note that the empM^ work wis cwled out In ciMiroomi of 
te^hm who had sevml yetfi of tiachizig exptrianea. Hence, the rasulti reported 
haia ue tas^ on infomiation from axperiena^ t^cher^ 

^TMb summ^ draws on approidmatily three d^en ttehnical reports and notes 
tiiat ^eumant wious aspae^ of the BICS. 
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14. A Mo^l of OamKim bsmicttoa 



iiiitfugtiQtiti 
pto^^s end 



Student 
apdtudei 




f 



Student ^iMroom 
iiirnisg (is Aown 
by student beha^or) 



Adiievemifit 
test scorn 



A Modal of damroom Instruction 

This modal of Qhrnoom instruction statas that, for a glvan studant, 
cartam initnictiond prootms lead to clanroom latraing, whidi is tiian 
raflaetid in aehiavamant tast scoras (ngura LI), bi tMi modal^ student 
aptitudai hava a diract bnpaat on bo^ studant olassroom laaming and 
aahiaviment test saoras. 

Tba pnaral modal spadflas and distinguidias two miasuras of studant 
letf ntag: studant alassroom baha^or and itudint aaMavamant tast scoras^ 
Laaming takas placa ovar tima in mind of tha studant. Tast sooras are 
ona useful indloator of lawitag, but tiiay ara not laaming itsalf. Th§ modal 
prdposad hara impUas that laaming ean abo ba maasurad mora directly 
and immadiately by lool^g at studant baha^or in Ae classroom. Hence ^ 
tha cantral alamant in fl^ra Ul is studant das^oom laaming, Tlia modal 
furthar implfas that olassroom uistruation and anvfronnient affaat studant 
leaning by first affeating tha obsambla dassroom lairning behaviors of 
tha student. 



Academic Learning Time 

During tha study, wa davelopad a maasura of student classroom learn* 
ing usng observabla studant b^a^or. Iliis maasura of studant learning is 
o^ad Apadamio I^umng Time (ALT) and is daflnad as the amount of 
tima a studant spends enpged in an aaadamlc task Aat s/ha can parfonn 
with hi^ success. Th^ mora ALT a student accuinidatas, tha mora the 
studant is laammg. 
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A €dneiet@ UQdtfstanding of the ^adimi€ Leaming Time concipt ean 
be faeflitatod by oo&iidiring a praetiod ixamplii,^ In steond^ade mathe* 
matios it iM sommon to tta^ addition. For taeh pupils a ctrtmn portion of 
di€ ndiool day is av^bla for #ork on addition problems. Thert is elearly 
an upper Unit on tima ar^ikble during school houii for the student to 
work on addition. Wt refer la tiiis quantity as Wtn^aUocated to addition. 
The time may be structured as one eontinuous block or as severd 
sepnents. 

For some of tfie aUo^isd tmiet the student wUl be actively enpged in 
work on addition; tfc^l % n/h$ wfll be paying attention to the addition 
tadc* For some of the tiuie, the stud^t wiU be off tasks or unenpged, for 
a variety of reasons. Since a student can learn oidy when s/he is In some 
way payvig attention^ a measuie of learning time should include only time 
during which the student is engaged. Hence » engaged time represents a 
somewhat more refined measure of student cla^room learning than the 
time allocated to addition. It includes that part of aUocated time during 
which the student is paying attention. 

The match between the task and student*s current knowledge level 
will also influence the amount learned. If ^e particular addition task is 
Y§ry difncult for the student and s^e produces few correct responses 
during the task^ tiie actiidty wfll not yidd mudi laaming for that student. 
On the oAer handi If tiie stud^t produces mmy correct responses on the 
tasks we hypoA^mm that leaniing is occurring. Thus the student's success 
rate on Ae task v^l partielly determine the amount of leaming. 

In the fie ^dwork, three broad levels of success on a task were identifled. 
Nigh succem describes dtuations where tiie student has a good grasp of ^e 
ta^ and only m^es occaiiond carele^ errors. If a stud^t does not under^ 
stand the task and makes correct responses at about the chance level, the 
situation is labeled tow swc€$$. Situations that fall betw^n low and hi^ 
success are defined as meduim smaess* Medium success involves partial 
understandmgs i^ere tiie student understands enou^ to produce some 
coirect rehouses but also commits errors due to limitationi in hisAier 
understandmg of the task. 

Hie ALT model proposes that more time spent working witii iU^ 
success leads to increwd achievement. However, It does not neces^rUy 
unply tiiat aU a student's time diould be spent in Ae hi^ success condi^ 
tion, nor does it imply that success corresponds to llttie effort on the 
part of the student. In fact, hi^ success will be attained sometime witii 



3The focus of Uib sfady is on student icquldtian of btiic i^!^ in ratcUng and 
mitlimiticii hinee Uii addition axampls. Howev^, in p^cjple, studmit limini 
time relivint to other goito of schooUng could be deflkid and meanired^ 
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relativf ly littili effort and soraitimis mth considarabli effort* Generally, it 
is expected ^t sonie bdaiiQe betw^n high and meium succiiS taskSt 
wift somiwhat mor^ activities it a high suoce^ level, wXL produce the 
moit student learning* Low suecess tasks would always be detrimantd to 
learnuig. 

To sunmiariEe, time sj^nt by a student enpged on a task that s/he can 
ptrfom mto high success Mid tfiat is dlrectiy relevant to an acadeniic 
outcome constitutes a m^sure of student claMroom learning* We refer to 
time spent under Aese conditions as Academic Learning Time (kW). TTie 
basic components of ALT are aUocated time, student enpgement, and 
student hi^ succe^ (balanced with some medium succe^). Hie ALT 
model states Aat the accumulation of Academic Learning Time will lead 
to pins in achievment 



Instructional Processes 

TTie teaming behaidors that influence student learning can be conceptu- 
alized u serving five interrelated functions* These are diaposis, pre* 
scriptlon, pre^nUtion, monitoring, and feedback* ^ese functions occur 
throu^ time in a roughly cyclical faslon, as shovra in figure 1 ,2. 



Figtm 1 .2, InsMctional Functions tk ttte Avenue L^niipg TsQia Model 
of Cl^^oom bistruction 
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The cydi of funGtions begins wiA a planning phase. teacher as 
organizir and d^lslonmaker assesses the current knowledge, skUl levels, 
and strenphs and weaknesses of the student (diaposis). S^e can then 
decide on apprppriate instructional goall and acti^ties, grouping and 
scheduluig (prescription). T^ese decisions set the stage for the interaction 
phase. 

Ilie interaction phase begjns with the pr^entation of concepts or learn^ 
ing tasks to the student, l^e student works on the task, and the teacher 
monitors ^e student's response to Imow whether the instructional goal is 
being achieved. Monitoring tells the teacher about the student's state of 
knowledge or skill during and following an instructional activity. Guided 
by infonnation fronn monitoring, the teacher mi^t provide feedback to 
the student, give additional explanation^ or cycle back to the beginning for 
further diag iOiis and pi^scription. 

It is important to realize Aat each of these functions can be fulfilled by 
a wide range of different specific beha^oi^, depending on th^ classroom 
organization^ the curriculum, or teacher preferences. For example, dieg^ 
nods may be accomplished by listening to a child read, tdking to a child 
about what s/he is interested in, watching the way a student works during 
an independent seat work assipiment, giving farmal tests, etc. What aU 
these activities have in common is that they pve the teacher information 
about the student* In this study we did not compare the effectivene^ of 
different behaviors within each function: we did not, for example, look 
for the best way to diagnose. Instead we looked more generaUy at whether 
these functions were fulfilled. We considered whether the teacher knew 
the skUl levels of individud students and whetiier sAie used diat inform a^ 
tion to make reasonable program d^isions. We looked at how often the 
teacher n^ade presentations, monitored, and gave feedback, '^e model 
imphes that it is important for these functions to be fulfilled, but that 
there are many acceptable ways to carty ftem out. 

Classroom Environment 

Classes may differ widely in such dimensions as enthusiasm, ^rm^, 
competitiveness, cooperation, and task orientation. Iliese variables and 
many odiers, which are ^obdly referred to as classroom environment, 
play an important role in instruction. Hie functional model of teacher 
processes, depicted in figure 1 .2, operates within particular classroom envi- 
ronments. Ufferences in environmental variables may influence Academic 
Learning Time directly. For example, some teachers value academic pur^ 
suits very highly and, hence, provide a classroom en^ronment that has 
hi^ academic press. Ihis press may tend to raise the general level of 
enppment in the classroom, 
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Diffi^ncis in invironmintd variables may also affect the relation^ip 
betwien teacMng prooess variables and facets of Acadimic Learning Time. 
For example, the spedflc b^aviors constituting feedback might be very 
different in classroomi where the climate differs in warmth. TTie behavior 
themselves mi^t diange^ or they mi^t be interpreted differently by 
itudents. The difference in warmtfi would then affect the relationdiip 
betw^n feedback and student enpgement. 

Summary 

Academic Learning Tune is an obserwble measure of ongoing student 
levnMg in die classroom. Ihe ALT modd of instruction states that the 
accumidation of Acadmic Learning Time represents learning taking place 
andj therefore^ results in increased student achievement. Hie model also 
states that teaching b^a^o^ have an impact on student achievement by 
influendng the facets of Academic I^rning Tune (time allocation^ enpge^ 
ment rates^ and su^ess rates), bi the models tiacl^g behaviors are cate^ 
gorized according to the initructional function ^ey fulf)ll-dlagnosis» 
prescription, presentation^ monitoring^ or feedback. Hiese functions occur 
in a cyclic^ pattern during instruction and each function may be fulflUed 
by a number of different bdia^o^. Hie model also reco^zes the impact 
of student aptitude and cla^room environment on student learning (see 
figure IJ). 

Overvtew of the Field Study 

T^e research portion of the Begirming Teacher Evduation Study cul- 
minated in an extenshre examination of the Academic Learning Time 
modeh^ Stud^t achievement in many areas of reading and mathematics 
was ass^sed in October and again in December and May. During th& 
intertast periods a wide variety of data on teaching behaviors, cla^room 
environments, and student classroom learning behaviors were collected. 

Subjects 

Volunteer teachers in schools serving rniddle to lower^middle social 
cSasa communities were recruited for the study. Ilie initial sample included 



^During the Bl^S, four lapmta ^^ples of itudents and imohm wsra itudled In 
four sequtntial (Ph^ e II» Vtiw III^A, Fhaie III-A Continuation, and Fha^ 
in-B). kst of th^ flald studiis, s<jnduetid duiing the 1977-78 schooi ym, is 
^mnmrized hiri^ The oamprehensive technical raport of the study is entitled 
Teschttg B^vion, Ai^demie Leming Tims and Student Aehi^ement, by Fisher 
etaL, I97i. 
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50 s^oiid ^de and 50 Mth padi teaQhers^ A spiciaUy selictid set of 
sub^es from BTES aahievamint battiiy was administered to 
students in these classes^ Clares were sileeted for the And study sample if 
six ituden^ in the ck^ (u^^y ^ee boys and three 0rls) were in the 
range from 30A to the 60A percentile in reading and ma^ematics, 
based on the to^ distribution of ^ores in this sample of classes. Hie 
selected students were predicted to^ow some academic growA but not 
reach cefling on Qia subscales used in the ftdl battery of achievement tests 
despied for tfus study (DAen, 1977)^ Hiese six target students ^thin a 
class were subjects of inteniive data collection throu^out the academic 
yw* 

The find sample of teachers included 25 second-pade and 21 flfth- 
^de teachers, mostly feinale (about 75 percent), ethnicaUy mbced (over 
20 percent nonwhite), and varied in age^ years of experience, and teaching 
style. Attfitioni mostly from student mobility, reduced the flnal sample of 
target students to 139 m grade two and 122 in grade Ave. Nonwhlte 
students constituted 40 and 30 percent of the student sample in second 
and flftii gmde, respictiydy. Target and non target students did not differ 
in measures of socioeconomic status. Approximately half of the sample 
com^ised cliildren of sl^ed or semisldlled parents; another 16 percent 
were children of unskilled or unemployed parents. 



Instrumentation and Procedures 

Achievement of target students in each class was measured with a 
comprehenMve achlevem^t battery in reading and mathematics (Fiiby and 
DidiaWi 1976). Each administration of the battery was canied out in four 
45"mtoute sessions^ completed over 3 schooldays. Most of the items were 
of the multiple choice formats Many different content are^ of the reading 
and mathematics curriculums were represented in the 50 subtesti of the 
^cond^ and fiftfi^^de batteries. The subt^ts were combined and reduced 
to a set of 26 scides for anal>^is. Selected achievement scales were ad- 
muiistered in September of the following year to assess retention. The 
dpha reliabilitiast test-retest reliabilities, and standard errors of the scales 
ware feported by project staff (FiAer et al.» 1978) and an independent 
tavestiptor (Wright and Wm, 1977). 

Stud^t attitudes toward reading, mathematics, and school were 
measufed in die second ^da by 16 items, using a 3-point response scale, 
Thtsa attitude were m^surad m the flfth pade by 24 items, using a 
7-point response scda. AJpha reliabflities and standard mot of measure- 
ment on ^ three test administrations were acceptable for research pur- 
poies (FiAer et al., 1978). 
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Timi aUoi^tad to reading and mathematics curriculum content cate* 
gories (e.g«» d^oding comoMnt blends, inferential comprehensfon, 
addition and subtraction with no regrouping, mathematics speed tests, 
etc,) recorded by teachers in daily lop. After training on logkeeping 
procedures, teachers r^orded allocated student time per day, per content 
catego^, for aU the school days between October and May. (See Di^aw, 
1977 a and b for a d^ription of procedures and summary data on dlo> 
cated time). 

Allocated time, enp^ment rates, and success rates for the target 
students were measured by direct obsenration of the target students by 
field observers, "nie obsemrs used a tim^b^ed rotating sample procedure, 
recording data on spedaUy designed opticdly scorable coding iheets. [In- 
strument development is described in MarUave, Fisher, FUby, and Didiaw 
(1977)* Data collection procedures and descriptive statistics are docu- 
mented in FUby and Marliave (1977) and in Fidier. Filby, and MarUave 
(1977)*] In this observation system the activity of each target student is 
sampled once approxtaately every 4 minutes. The reading or mathematics 
curriculum content area w^ r^orded u^ng categories that corresponded 
to those of ttie teacher lop described above* The student's engagement 
(involvement, on-task behavior^ attending) or nonenpgement with the in- 
structional task was coded* Ilie student's level of success was also cate^ 
gorized* Success was coded h^, medium, or low as a function of the 
particular target student's response to the current task. 

Interactive teaching behaviors were also measured as part of the direct 
observation system. A number of variables issodated with the teacher's 
behavior were coded if, at the moment of observation, tiie student and 
teacher were involved in some interaction. Seven interactive teaching be- 
haviors, comprising three general categories, were coded: presentation, in- 
cluding planned explanations, unplanned explanations, and providing 
structuring or directions; monitoring, Induding obseiving student activities 
and questioning students: and feedback, induding feedback about student 
academic responses and feedback designed to control student attention to 
the task. Tlieie general categories of interactive teacher behavior are 
three of the Ave general teaching functions examined in this study and 
described above* 

Obsemtions In a classroom were conducted for a complete dayi once 
each week, for over 20 weeks of the school year from October to May. AU 
observer had prior teaching or research experience. Ihe observers, who 
were trained intensively for 3 w^ks, were responsible for visiting ei^t 
classes, once each, over a 2-week period, ^us, each classroom w^ alter- 
nately \dsited by two different observers, and each observer was 
re^onsible for being famSiar with the classroom work and behavior of 48 
target students. Paired observations were also carried out throu^out the 
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data CGnietion p€fiod, to providi reUabflity estimates of the obsamtions 
(Fflby and MKliavi, ISTT^and Fishtr, Filby, and Marlitvi, 1977), 

Tim tiller planniiig taietiOM (diagnosis and presoription) were 
aseMed from gene^ intenrtews in tiie M and the spring of the year, diort 
weekfy intemewi, and t^cherf predictiom of item difflculty for target 
student. In addition^ gineid charaQteristies of tfie classroom and ^e in^ 
smietional propam ware rated eadi w^k by the fleld obsemr. Fifteen 
s^es were used to meaiwe ludi variables as elassroom aooperationt cog* 
nitive task orientation, tiie teaeher's clarity of pr^ntarion and abruptiie^ 
toward students, and the teacher's knowledge of subject matter. Extensive 
preliminary analysis was done to deflne and select variables for inclusion in 
rekriond andyses (Filby and CAen, 1977, 1978), 

The nnajor anriysis of these data a^essed relation^ps between 

(1) facets of Acad^c Leammg lOme and student aAievement and 

(2) teachMg behaviors and student learning, as measured by ALT and 
student aduevament, Relationdil^ in Ae data ware identifled using a 
number of methodolo^cd stratepes; however, most of the analyses were 
cast in tfia form of tiie multiple linear repemon model 0larliave at al., 
1977 a aid b; Filby and Cahan, 1 977, 1 978; and Fisher et al,, 1 978> 

Fourteen major flndinp from this field study are organized in two 
poups* The first set of fln^p reports relationships between Academic 
Learning Time and student achiavamant. Hia second set coven teaching 
proc^es and classroom environment in relation^ip to student laaming. 

Academic Leaming Time and Student Achievement 

Th§ smmnt of tim€ that tmahm slit^te to instruction in a psrticukr cw^ 
F^mlum content wm is positively assoeisted with student timing in that 
contmt ama, 

Taacheis ^o aOocate more time to a partieulu content uea of the 
curriculum have students who achieve at hi^er levds than taachirs who 
^o^te la^ time to tiiat content area. Very larp differences in time 
location ware observed ^tw^n claMas^ For exam^e, the average 
miount of dlooated to matfiamatics in second^pade elates varied 
from 25 nrinutes per day in one chm to 60 mbiutas per day in anoAer 
dass. In flfA grade r^dmg and raading^ralated instruction^ Aa average 
mount of allocated time wm found to vuy from about 60 minutes per 
day In some cla^s to about 140 minutes par day in other cla^ei. 
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Within reading and mathematics^ classes differed in the amount of time 
allocated to different skfll areas. For example, in one second-grade class 
tile average student received 9 minutes of instruction over the whole 
^hool year in the arithmetic associated with the use of money. 'Hiis figure 
cm be contrasted ^th cla^s where the average second grader was alio- 
Mted 315 minutes per school year in the curriculum content a"ea of 
money. As another example, in the fifth grade some classes received less 
than 1 iOOO minutes of instruction in reading comprehension for the school 
y^r (about 10 minutes per day). This figure can be contrasted with classes 
where the averap student was allocated almost 5,000 minutes of instruc- 
tion related to comprehension during the school year (about 50 minutes 
per day). 

The differences in time allocations at the level of "reading'' and 
"mathematics" and at the level of specific subcontent areas are substantial. 
TTiese differences in how teachers allocate time are related to differences 
in student leamiftg. Other tWnp being equd, the more time allQcated to a 
content area, the higher the academic achievement. 

The proportion ofaUocaHd time that students art engsged is positively associ" 
ated mth Imning* 

Allocated time sets an upper bound on the amount of inschool learning 
time a student has. Student nonenpgement operates to reduce actud 
learning time below this upper bound. Within the reading periods for ex- 
ample, students pay attention to the task only part of the time. Dxb 
percentage of the time tiiat students are engaged is related to learning. 
Students who pay attention more learn more. 

Tills bade fact is not very startling; without attention, little can be 
learned. However^ tiie data revaal that the average rate of engagement 
varies widely across classes and among individua] students. For example, 
during reading and mathematics instruction there were classes that had an 
average enpgement rate of about 50 percent. Hiis means tiiat students were 
attending to tiieir work only hdf of the time. In other classes, the average 
engagement rate approached 90 percent* In other words, two classes might 
allocate the same amount of time to reading instruction, but one class 
might have almost twice as much real engaged learning time as the other. 
Since engagement rate has been shown to be hi^y variable across classes 
and since Aat variability has been empirically related to achievement, it is 
possible that increasing engagement rates will lead to increased 
achievement. 

The proportion of time that reading or mathematics tasks ere performed with 
hi^ success is positiveiy assocmted with student learning. 
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Three rather broad categoric* described above, were used in this study 
to define the difficulty level of the material or activities for individual 
students: hi^ success, medium success, and low success. Our findinp 
consistently point out the positive effects of school tasks that are per» 
formed with hi^ success; i.e., correctly* Other research on instructional 
desipi has stressed the importance of high succe^ rates. High success rate 
in scholastic activities has riso been found to be one of the factors that 
contributes to hi^ levels of student self-esteem. 

The average student in the study spent about half the time working on 
tasks that provided high success^ In grade five mathematics, the average 
was somewhat less— about one-third of instructional time was hi^ success. 
Students who spent more time than the average in hi^ success activities 
had higher achievement scores in the spring, better retention of learning 
over ^e summer, and more positive attitudes toward school. 

The idea of success rate is more understandable if one thinks about the 
cyclical nature of learning. Learning is a process of moving from not 
knowing to knowing. Wien new material is introduced the student most 
Ukely will not understand completely and will make some errors. Guided 
practice and/or explanation help the student understand, and s/he comes 
to make fewer errors. Eventually, the student will perform correctly, al- 
thou^ probably with some effort. Learning will become weU establidied 
and further work will be practice or review; this stage could be viewed as 
one of consolidation. At some later point, the student knows the materid 
so well that further practice is of minimal value; it is time to move on to 
something new. Our results suggest that for learning of basic skills in the 
elementary grades, the stage of successfid practiae (consolidation) is par- 
ticularly important to the thorou^ mastery of concepts and procedures. 

Although we have emphasized the importance of giving students ample 
opportunity for successful practice, we must point out that it would not 
be desirable for students to spend all of their time on tasks they can 
perform completely correctly. Common sense suggests that too high a rate 
of high success work might be boring and repetitive and could Inhibit the 
development of persistence. Probably, some bdance between hi^ succe^ 
and more chaUen^g work is appropriate. Also, we found that older 
studenti and/or students who were generally skilled at school learning did 
not require as high a percentage of time at the hi^ success level. Appar- 
ently these students had learned problem solving-how to take a task they 
did not completely understand and work it out. Such students are able to 
undertake the challenge of more difficult material, as long as they eventu- 
dHy experience success. 

77ie proportion of time that reading or mathefnatias tasks are performed with 
low success is negativefy associated with student iwning. 
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yfhen students worked with materials or activities that yielded a low 
succ^ rate, achievement w^ lower. In this study, no teacher assigned a 
proportion of materials that were exceptionally hard for students. 
However, some students worked on materiis judged to be excessively 
difficult for them as much as 20 percent of the time. Other students never 
worked at a low success rate. Students who were observed to spend more 
time on exce^ively difficult material generaliy learned less than other 
students. It is seldom, if ever, desirable for elementary level students to be 
given tasks in which they experience low success. 

Increases in Amdemw Learning Time ere not amoclated with more negative 
attitudes toward mathematics, rmding, or school 

The data from this study revealed that students with hi^ and low rates 
of allocated and engaged time were equdly likely to have positive or 
neptive attitudes toward the subject matter and the school. Educators are 
natu rally con^med about whether greater than average time in academic 
pursuits or greater thm averap rates of attention wfll result in negative 
attitude In the current study, that did not happen. In fact, there is one 
condstent, positive trend in the data. It appeals that students experiencing 
high rates of success are somewhat more likely to have an increasingly 
positive attftude toward readingi mathematics, and school. 

Summary, The first five flndinp are concerned with measures of on- 
going student learning and thm association with student achievement. 
Academic Learning Time is an important predictor of student achieve- 
ment. Allocated time, enpgement rate, and success rate on school 
activities are all associated with student achievement. Students who accu- 
mulate more Academic Learning Time generally have hi^er scores on 
achievement tests. This means that Academic Learning Time can be inter- 
preted as an immediate^ ongoing measure of student learning. Also, 
students do not generally develop neptive attitudes when they have large 
amounts of Academic Learning Time, and high success may contribute to 
positive attitudes. 

Relationship oflnstmciion Processes and Classroorn 
Environment to Student Learning 

Botii student achievement and Academic Learning Time are measures 
of student learning. The next question is' Wiat impact do teaching be- 
haWors and characteristics of the cla^room environment have on student 
learning? Student achievement, enpgement rate, and success rate were all 
used as measures of a^ects of learning* Measure of the five teaching func- 
tions and of dassroom enviroruiient were related to these outcome 
measures, ^is section reports major flndinp* 
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tmcher's accumcy in dkgnosing student skitt levels is rskted to student 
sehievement andAmdemk Lmfning Time, 

Teacheii were aiked to predict how their students would do on certain 
test items used in the achievement battety. "Diis accuracy in predicting 
student perforinance was used as a mwsure of the teacher's diapostic 
ability. A positive relation^p w^ found betw^n a teacher's diagnostic 
ability and the reading and matfiematics achievment of students. Wag- 
nostlc ability probably relate to student aduevement by working, in part, 
Arough student Academic Learning Time, ^e teacher's diapiostic ability 
was neptively related to low success rate (that is, the better the teacher 
was as a diagnostician, the less likely s^e was to prescribe materids that 
were extremely difflcult). Tlie diapostic ability of the teacher was also 
poatively related to student enpgement. Among teachers in this sample, 
the better diagnosticians generally had students who ^owed hi^er rates 
of enpgement. The evidence, althou^ not always consistent, suggests that 
improving the teacher's ability to make an accurate assessment of student 
perfomance would have positive effects on student learning. 

The tmdter's prescription of appropHate tasks is related to student achieve- 
ment and sttddent mecess rate. 

The cla^room observers in this study rated the '^appropriateness" of 
instruction in the elates tfiey examined. In making these ratinp, they 
were asked to think about how reasonable the instruction was for those 
particular students; that is, whether the instruction generally matched the 
needs and skiU levels of individual chfldren. This rating of appropriateness 
generally was positively related to achievement. Appropriateness in pre- 
i^ribtng laming activities probably relates to student achievement partly 
because of the relationship between appropriateness and Academic Learn- 
ing Time. Appropriatiness of prescription was related to the proportion of 
time students had low success on their work: W^er ratinp of appropriate- 
ness were always associated with less frequent occurrences of very hard 
materiaL 

More su^tantive (nteraetion between the student and an instructor is associ- 
ated with hitter levils of student enga^ment 

Substantive interaction between teachers and students consisted of 
presentetion of information on academic content, monitortag of work, 
and feedback about performance. Most student-teacher interaction took 
pbce in a poup setting, wito only a small part of such interaction occur- 
ring during leatwork as one-to^ne "tutoring." Students who spent more 
time in a poup setting had hi^er rates of enpgement. Wien poup time 
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wii eha^ctirizid by hi^ levels of subitantive interaction (as oppo^id to 
orgamzitionM taaki or waiting for othen), inpgsment rates were hi^er 
during poupwork ar^ during ieatwork. ^en students received more eon^ 
tact wiA an instructor during seatwork, enpgement rates were higher in 
seatwork. Enpgemetit rates were esp^ially low when students spent two- 
thuds or more of Aeir time in seatwork and had little interaction witii an 
instructor. Tlie use of aides, pvent volunteers, cro^-age tutors, and peer 
tutors mcreases the annount ot interactive instruction and can be pre- 
sunned, therefore, to keep engagenient rates hi^er. Thus this finding has 
impUcadons for class size^ individudized instruction^ use of aides, and 
pouping pracdces. Iliose allocations of resources and those organizational 
arranpments that aUow for more substantive interaction between in- 
structor and student wOl be preferred because of the pomtive EM^iation 
of substantive interaction with student engagement. 

Amdmic f€0dh^k is pMtivdy snocMted with student ieaming^ 

Academic feedback w^ defined as information ^ven to the student 
about whedier his or her answers were ri^t or wrong. Many different 
^^iflc b^iaviors fulfilled this function, including answering questions in 
clasSt checl^g papers, using programmed texts, and listening to or^ 
reading. The perc^tap of instruction^ time during which the student 
received feedback was podtively rdated to student engagement rate and to 
achievements Hence more academic feedback may lead to higher enpge- 
ment and achievement. 

Stmcmrirtg ths !&swn and giving dir&gtioni on tsMk procedures were p^itively 
a^ctated wiih hi^ itudent mseem 

Teachers who pve dir^tions more often and spent time discussing the 
structure of the lesson had students who showed a greater rate of hi^ 
success. Anecdotal reports suggest that students sometimes do not know 
what they are suppoied to be doing or how they are supposed to mark a 
particular work^eet. Clari^ng activities by the teacher can help raise 
student achievement by affecting the hi^ success rate component of 
Academic Leammg Time. 

Expkmtion speciflcaUy in respmse to student need is negstively a^ockted 
with hips Mtitdent mccmi. 

One teaching behavior was explanation in response to student need. 
lUs occuzred when a student did not understand something and the 
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teadiir fxplamed it to him. Most ixplanation-n^d occurred during seat- 
work. Studenti who r^sivcd more explination in risponse to need tended 
to have fewer succeis t^ks and more low success tasks. From a 
sUgJitiy different perspective^ a student who had more need received more 
explanation in r^ponse to need. Apparently^ ^ou^, the explanation did 
not solve the problem since, in &e long run, the student had litde high 
piccess. Fraquant need for explanation may be a si^al ^at changes are 
needed in the student's instruction^ program, either in the difficulty of 
Ae asii^ments or in preparation for seatwork. 

More frgqumt rtprtmsnds for insppraprkt& b^sylorere negative^ amoctated 
with itudsnt Iwnmg^ 

The study exmined the im^ct of task enpgement feedback or "inform 
mation pven to the studait about whe Aer his behavior was acceptable or 
unacceptable/' Usually task enpgraent feedback amountad to a reminder 
to the student to get back to work. Such reminders were pven more often 
to students who were offtaik more often. Hiey were also ^ven more often 
to students for whom some tasks were excessively hard. It may be that 
some students are sometimes unable to do tasks th^ have been a^gned, 
so they do not workj and the teacher then reprimwds them for not 
workbig. Student who received more frequent reprimands also tended to 
show less powth on aduevement tests. It is hard to imapne teaching 
without reminding students of the r^es for acceptable behavior. However 
the need for frequent reminders may be a sip of trouble. 

Th§ tmdi€r*s valus ^um is related to Amdgmic Lmrnini Time snd to 
itudent achigvement. T^eher empfm^ on academic goals ii poMvely ass^ 
slated with mdmt learnings 

Classes judged to have high emphaas on academic perfomiance 
typically diowed h^ levels of achievement. More of the unusually hig^^ 
achieving clams, as o^osed to Uie unusually low-achieving classes, had 
teachers characterized by a strong academic orientation. These classes were 
not necesMrily "-cold" or unconcerned with student feeUnp. They did, 
however, emphaiiie the importance of school learning. In contrast, some 
classes were primarily oriented to\^rd affective outcomes^ such as itudent 
attitudes and feeUnp. In these elates, less time was allocated to academic 
instrucUon, student enpgement rates were lower, students were more 
likely to be g^ven low access tadcs, and student achlevemont was therefore 
lower. Nothing in these data su^ests that classes should be free of affect— 
qirite the cont^^. But the e^dence is clear that when teacher attention to 
acadanic instrucdon is subst^tially reduced, students achieve less. 
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A iemmg envtmnment cfmmcferized by student respomibUity for aeademic 
work and by cooperation on amdmic tasks is amocmted with higher 
achievement 

In clasi^ where students took responsibility for their classwork and 
belonginp and where students hilped each otheri shared materials, and 
worked together, achievement was generally hi^er. Descriptions of 
specific Clares indicated that this relationslUp held most often when there 
was a hi^ level of academic focus in the classroom. In other words, where 
students worked together to reach academic goals and where they took 
re^onsibflity for achieving them, achievement was hi^er. Cooperation 
and student responsibility in nonacademic pu^uits did not have this 
effect. 

Some Implications 

In this section we go beyond the major findinp and discus possible 
implications of the study. Our goal is to underline those issues we believe 
to be important for elementary education and to integrate the objective 
results ^th belief based on experience. The study used conelational 
methodolop' and| thereforej we have demonstrated no causal relation- 
ships. In this section i we make strong inferences in translating the findings 
into statements that can be applied to elementary school teachers and 
stud^ts in general. 

Academic Learning Time and Achievement 

A major finding of the study is that increases in Academic Learning Time 
are associated with increases in student achievement. The practical impor- 
tance of Academic Learning Time in relationAip to achievement is illus- 
trated by an example from our analyas of grade two reading instruction. 
Consider a grade two student whose October reading score w^ average for 
the sample of students in the study (50th percentile). If this student 
experiences the average amount of Academic Learning Time (573 minutes 
total, or 23 minutes per day in reading), the student can be expected to 
show average reading achievement in December (SOth percentile again). It 
is important to note that the '^average'* student with ^'average" Academic 
Learning Time does show considerable learning in terms of predicted raw 
scores. If this average student experiences only 4 minutes per day of 
Academic Learning Time (100 minutes totd for the interest period), then 
s/he would be expected to diow almost no change in raw score and would 
decline considerably in relative terms (50th percentile in October, 39th 
percentile in December). If the same student experiences very large 
amounts of Academic Learning Time, say 52 minutes per day* then s/he 
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could be fxp^ted to show comiderable improvenient in reading achieve- 
mint rf lativi to the other itudints in the itudy (SOth percentile in October, 
66th percentile in December). TTius, the student with large arnounts of 
Academie Learning Time benefits substantially. Note that the December 
Kore is an "expected'' score, That is, the average December score wUl 
equal this expected score for a large group of students. However* for a 
specific student the actud score wiU vary considerably around the ex= 
pected score. 

It may appear that this range from 4 to 52 minutes per day is unrealii- 
ticaUy large. However, these times actually occurred in the classes in the 
study. Furthermoret it is easy to imagine how either 4 or 52 minutes per 
day of Academic Learning Time might come about. If 50 minutes of 
reading instruction per day is allocated to a student who pays attention 
about a third of the tim e, and one^fourth of the student's reading time is 
at a high level of succr the student will experience only about 4 minutes 
of enpged reading at ^ .ugh success level. Similarly, if 1 00 minutes per day 
is allocated to reading for a student who pays attention 85 percent of the 
time, at a high level of suece^ for almost two'thirds of that timCs then s/he 
will experience about 52 minutes of Academic Learning Time per day, 

T}ie Learning Student 

A student who accumulates large amounts of Academic Learning Time 
may be characterized as foUo^. First, the learning student works on an 
academic task that is designed to result in increased knowledge or skills. 
The amount of time that the student spends in a given knowledge or skUl 
area is directly and positively related to learning in that area. Furtherniore, 
this appears to be as true for the more conceptual knowledge areas (com- 
prehension) as it is for the more basic skill areas (decoding). TTierefores the 
learning student spends relatively great amounts of time working on tasks 
that are directly related to the subject matter to be learned. 

The learning student is also very attentive. SIht is actively involved in 
the task at hand, probably with some enthusiasm. Hie learning student is 
bu^ performing the academic part of the task, rather than diarpening 
pencflSf looking for a book, or waiting in line to ask the teacher a question. 
S^e is not "socializing" or daydreaming. Neverdieless, the student is en- 
joying the activity, and paying attention for relatively long periods of time 
does not upset the student. 

The learning student spends a lot of time practicing and reviewing sldlls. 
S^e undertakes an activity related to a new skUl only after thorou^ly 
learning skUls prerequisite to the new skill, so s/^e virtually never en- 
counters an acti^ty that is really entirely "new," TTiere is always some 
need for consolidation of acquired skills (practice), but as the student 
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advances, sAie aQtu^y "learns how to learn": it beconiis easier to acquire 
newer skflls ^thout so long a period for consolidation of prerequisite 
skflls, 

A major conclusion is that this "learning student"' is not necessarily an 
unhappy student. Tlie learning student does not learn to dislike learning. 
Wt do not find any evidence that students are le^ satisfied when the shear 
quantity of work (allocated time) is relatively great. Furthirmore, we do 
not find that students who pay more attention (work intensively) acquire 
a distaste for learning. In faet, there is some indication that high attention 
is usudly the result of interest and enthusiasm, rather than coercion, so 
high rates of attention represent a more positive attitude toward learning. 

It is interesting to note that the high success component of learning is 
a^ociated with more positive student attitudis, Succewful students prob- 
ably enjoy learning more because of their success. Failure, even when it is 
only occasional, Eppears to result in a more negative attitude among ele- 
mentery school students. 

To some extentt the characteristics of the learning student are under 
the direct control of the teacher. Teachers make decisions about what to 
teach and how much time to spend on a paFticular goal. The ALT model 
implies that these decisions are very important. Teachers should be aware 
of how much time is really being spent on different skill areas* Classroom 
time is limited^ so teachers should be careful to spend time on those 
activities that they consider the most important. If some skills are particu* 
larly important for students, it would be reasonabie to spend large 
amounts of time on those skills. 

The student's suceess rate is also largely under the direct control of the 
teacher. As teachers assign tasks to students, they should try to match the 
task to the student's skill leveU thereby providing frequent high suceess. 
This strategy is particularly promising at earlier grades and for less ad- 
vanced students. Note that there have been previous advocates of this 
approach (programed learning and mastery learning. Howeverj many 
teachers probably do not recopiize the extent to which less advanced 
students need pfactice and review. 

Effective Teaching 

Diagnosis. The data support the conclusion that diagnosis is an impor- 
tant part of effective teaching. Students learn more when teachers know 
more about what their individual students can and cannot do. 

In this study we were primarily interested In cognitive achievement. To 
foster cognitive achievement, it is important for the teacher to know the 
co^itive skills and level of perfomiance of individual students. To 
measure teacher diapostic skills, we asked teachers to predict how 
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their students would do on representative items from the BTK test 
battety. Stiidenti learned more when their teaehers were more accurate in 
predicting performance, 

Teachere were more accurate in predating cogiitive perfoiTnance when 
Aey taiew more about the subject matter and when they attended to 
differences betwwn students. Teachers who can make accurate diapioses 
have estabU^ed a foundation for instructional planning. 

Prescnptian Prewription refers to the proce^ of deciding what 
students may work on in the classroom. It is a complex area to describe 
and evduate. 

l^e major positive factor in this area was the ^^appropriateness" of the 
instructional program for the needs of ^e students, Tliis variable repre- 
sents the integration of the two planning functions, diaposis and prescrip- 
tion. It assesses tiie extent to which teacheri use their knowledge of indi' 
vidual studente to prescribe apparently reasonable instructional programs^ 
matched to the needs of students. Appropriateness was related to succe^ 
rate and to achievement. 

Our m^ure of appropriaten^ was a rating made by trained field- 
workers based on interviews and extensive observation. Fieldworkers were 
asked to condder the pacing of instruction— whether fMter students could 
move ahead whfle dower students received extra help. They were asked to 
conrtder student success rate. They were pven a hypotiietieal example of 
appropriateness— that the teacher mi^t notice a student's interest in 
mathematical p uzzl es and bring in some addition^ materials that the 
student ml^t be interested in— and an example of inappropriate 
instruction— the teacher having aU students in the same reading book re- 
gardless of clear differences in r^cUng skfll. 

Fieldworkers were also asked to pve tiie r^sons for some of their 
ratinp. The most salient dimenaon In second^rade elates appeared to be 
flexibility of grouping, ^en noting ir^tances of appropriateness, field- 
workers often commented tiiat Ae teacher would **repoup students ac- 
cordmg to needs" or that a student who was doing paftic^arly well or 
particularly poorly wm moved to anotiier group. For grade Ave classes, 
ftis ^me dimenMon appeared, but fieldworkers dso seemed to attend to 
the overall orpnizational structure of the class. Indi^dd^ized pro-ams in 
grade five tended to be rated relatively hi^ on appropriateness, 

Tlie deflnition of "appropriate'* used for the ratinp was fairly broad 
and general. It assesses not whether each student was given the best in- 
struction for Wi or her needs (something that would be impossible to 
determine), but instead whether tiie program appears to be reasonabie for 
the different students in the class. 

Presentatiafu Presentation sMls ap^ar to be useful for increasing 
itudent enppment in mathematics* Teacheis tend to explain concepts 
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inori often in mathematics than in readin|. (The term '*explain" is used 
broadly here; demonitrating the steps involved in an addition problem 
would be consdered explinationO Students pay attention more in mathe* 
matics when they receive more frequent planned presentation of concepts 
in a ^oup setting. They also pay attention more when the teacher spends 
time discusing the loaJs or structure of the lesson and/or giving directions 
about what the students are to do. Perhaps because of the tendency to ^ve 
relatively more seatwork in math than in reading and because of the vari- 
ety of problems to work, it is important that students know both what the 
context of the lesson is and what they are to do. Then they become more 
Involved in the task. 

In both reading and math, students tend to make fewer errors on daily 
tasks when teachers spend more time structuring the lesson and giving 
directions. It seems critical that students understand what they are sup- 
posed to do so that they can respond correctly. Descriptions of particu- 
larly successful elates often mentioned that the teacher had a regular 
routine of beprmlng each lesson with a presentation in a group setting. 
TTie teacher would teU the students what they were going to work on, 
make sure all students underetood the assigninenti and go over examples 
where appropriate. 

One kind of presentation was consistently associated with less high 
success and more low success' explanation of academic content speci- 
fically in response to student need. Students who made more errors and 
did not understand classroom assignments received more explanation 
specifically in response to need. In diort, students who needed help, got 
help, Althou^ this seems reasonable , teadiers should be vmty of over- 
reliance on this technique. Explanation should increase underetanding and 
increase the overall frequency of high success. In our classeSs this did not 
dways happen. The danger is that explanation-need is too little, too late. 
Frequent use of explanation-need mi^t best be interpreted as a symptom 
that the success level or pacing of instruction is inappropriate for the 
student. Major changes in the tasks mi^t be in order. 

Monitoring. Monitoring is keeping track of student progress on instruc- 
tional tasks, Ihe major form of monitoring that we observed was teacher 
questioning in a group setting. Teacher questions account for about one- 
third of the interactive, substantive instruction that takes place. Students 
pay attention more when they are more often involved in substantive 
interactionj and teacher questions are an important part of that process, 
^ey involve the students in the interaction and give the teacher informa- 
tion about what the students understand. 

The term monitoring can also be used to refer to the teacher behavior 
of circulating around the room during seatwork, checking on how students 
are doing. We found that a teacher rarely stops to observe a student's work 
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^thout making some commentp providing feedback or explanation. When 
a student receives this land of attention from an instructor durini seat- 
work, s/he pays attention more, TTius, it is a good idea to monitor seat- 
work by going around the room pving help or feedback as frequently as 
poiiibie* Ascriptions of hi^-achieving classes surest that good teachers 
do this not only to keep students on task, but also to find out as much as 
they can about how students are doing so they can plan further instruc- 
tion. 

Feedback. One particularly important teaching activity is providing aca- 
demic feedback to students O^tting tiiem taiow whether their answers are 
rig^t or wrong, or ^ving tfiem tiie ri^t answer). Academic feedback 
^ould be provided as often as po^ible to students. When more frequent 
feedback is offered, students pay attention more and learn more. Academic 
feedback was more stron^y and condstently related to achievement than 
any of the other teaching behaviors. 

Academic feedback as defined in the observation system includes many 
different behaviors. We do not know at this point v^at types of feedback 
mi^t be more valuable than others. We can at least suggest some of the 
po^bUitie^ 

As defined in tWs study, feedback is the major component in group 
interaction. Mudi classroom interaction foUoM^ a question-and-answer or 
r^itation format: the teacher asks a question; a student answers the ques- 
tion. Presumably, when the teacher asks a question aU students are sup- 
posed to think of an answer. When some student ^ves an answer oraUy, 
each student gets feedback on his or her internal answer. So, when one 
student gave an answer aloudi our observers conadered it feedback to 
students listening to the answer. It can also be thou^t of as a form of 
"modeling." This kind of feedback within group interaction is an impor- 
tant way to encourage student attention as well as teach content* 

Some classes that we observed had a regular routine of meeting as a 
group to check answers on ^oup asdgnments. One flfth-pade maA class 
had reguiir homework a^ipments and spent the first part of each day 
going over tiiem* ftesumably, students are more likely to complete tasks 
when they loiow they be held accountable. 

An oral reading cirde was also a situation we defined as involving hi^ 
levels of feedback. Much Uke Uie recitation sequence, oral reading was 
conadered feedback to a student ^o was reading along sUently. The 
teacher mi^t dso correct errors, tiius providing feedback to all students. 
TMs important purpose for oral reading Aould be kept in mind. 

Noncredendaled instructors such as aides, volunteersi and peers can 
provide feedback. To plan instruction « choose learning tasks» or explain 
concepts requires somi sWl as an instructori and probably some training. 
But anyone who knows the answer to a problem can teU a student whether 
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m answer is ri^t or wrong, or pva the answer to the student. Since an 
important part of learning is responding and receiving feedback, aU class- 
room penonnel Aould be used wherever powible to provide feedback. 

Feedback can also come from the curriculum materials raAer than a 
human tartructor. Pro^ained texts are organized to provide immediate 
feedback. T^e curriculum also provides feedback when students check 
their answers in the back of the book or with an answer key. Feedback 
from the curriculum was not frequent in our classesi but it could be an 
important way to incre^a the amount of feedback students receive. 

In addition to ^ademlc feedback^ ve also looked at taik engagement 
feedback-feedback to the student about Aether classroom behavior was 
acceptable or unacceptable. Most of the task enpgement feedback we 
observed turned out to be neptive, such as remmders to students to get 
back to work ^en tiiey ware oflf t^k. We found no e^dence that fre- 
quent use of repranands had any positive effect. It may be that some 
well-timed and wefl-phrased reminders are usefulp but when task enpge 
ment feedback becomes frequent it is a sip tiiat some structural ch^ges 
are needed, Tliere is an important lesson here for teachers who use tiiese 
findings to increaaa student enpgemCTt^ Scolding students more often is 
not tile anpver. Insteadi one mi^t (1) check to see that tasks are not too 
hard for the student (task engagement feedback was positively correlated 
^th low succe^ rate), (2) increase the clarity and emphasis mth which 
expeclations are stated and tiie consistency with which students are hdd 
accountabiei or (3) increase the amount of substantive inter^tive instruct 
tion. 

A find comment comes from descriptions of hi^-achieving classes. 
These classes tended to have some type of positive reward system. Good 
work was rewarded. Such rewards were not frequent, but students had 
some sensei formal or informal* of what they had to do to get them. Hiere 
seems to be value In reward systems that aclmowledge major learning 
events; tfiey ^ve the student recopition for working and for succeeding. 

Context Schooling has many different purposes. One purpose is cogni- 
tive learning. Others might be developing independent work habits, learn- 
ing social interaction sWUs, feeling good about oneself, enjoying work, 
appreciating the fine arts, or keeping students off the street. Most teachers 
vdue and work toward a number of different outcomes. Because the study 
focused primarily on copitive tutcom^, we cannot ftiUy evaluate class- 
room instruction. Our data do point out, thou^, that choices must be 
made and that teachers dioidd be aware of the choices Aey can and do 
make. 

Two of the general variables in the study described the focus or ori- 
entation of flie teacher. One was academic orientation-the extent to 
which &e teacher emphasized, valued, and worked tow^d copiitive 
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achieygment. TTia other was orientation toward afffCt-the extent to 
wiUch the teacher was aTOre of, aelaiowled|ed, and valuid itudent 
faelinp. 

Examining thesa variables in relationship to studint engagement and 
student aehieviment reinforced the old maxim, 'Tint things first." If the 
teacher's goal is to have every student show substantial growtii on basic 
skfllSj then it is important that the teacher diow his or her commitment to 
aehieving that goal. The teachir must be wUling to aUoeate classroom time 
to academic instruction and must communicati to the students the belief 
that academic laaming is important. Hie teacher must be willing to make a 
personal effort to reach that god. 

Some teachers in our study placed primary emphasis on affective 
outcomes^music, personal development, and good feeling. Under these 
conditions, both ALT and achievement were relatively low. 

Many teachers gjve first priority to academic instruction but also con- 
sider student feelinp and value human development. Tliere were examples 
in both grades of teachers who made a sincere effort to provide competent 
academic instruction and also to take into account student interests and 
human feelinp. Often these classes were in the middle range of ALT and of 
achievement. 

Ano^er context variable, "learning environment,*' needs to be con- 
side red. This variable was a composite of two ratings— one on "cQopera» 
tion," the other on "student responsibility.*' Especially in grade two, 
classes higher jn learning environment tended to have hi^er achievement. 
Both components, cooperation and student responsibility, contributed to 
this effect. Wien students worked together to reach academic goals and 
when they took responsibility for achieving them, achievement was hi^er. 
Cooperation and student responsibility in nonacademic pursuits did not 
have this effect. 

An image of a model class could be constructed from these results: 
there is a clear focus on cognitive learning; the students expect to work 
and are held responsible for doing so; the teacher cares about the students 
and wants to help them learn; teacher and students interact comfortably 
^d frequently on work activities. In other words, it is a class where the 
teacher emphasizes the belief that the purpose of school is learning and 
fosters an environment where everyone, teacher and students, works to- 
gether to reach that goal. 

Use of the ALT Model 

Teaching is a complex process. The ALT model tries to ded with the 
reality of teaching. It is therefore a complex model. It is intended to 
provide a cohirent, general framework for analyzing and describing the 
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teiching-learning process. Wa think this makes the model widely applicable 
to many approaches to elementary school teaching. 

It would be appropriate to use the model as a basis for obierving, 
analyzini, and discussing ways to teach. Teachers and prospective teachers 
might benefit from a chance to examine the concepts in the ALT model 
and to use them for systematic observation in a variety of classei. A 
chance to watch the learning student would be particularly valuable, since 
teachers lose sight of the indmdual student learning process when they 
must manage an entire clasi. If different instructional approaches were 
observed, teachers could analyze the different ways in which tfie five 
teaching functions of the model were (or were not) fulfilled. 

Teachers studying the ALT model would have to understand it as a 
framework both for student and teacher behaviors. Academic Learning 
Time provides the student behavior framework. Since Academic Learning 
Time occun simultaneQudy with instruction itself, it provides an individ- 
ual student variable for assessing the impact of instruction. Therefore, 
Academic Learning Time is of potentially great value as an information 
tool to be used by teachers in the evaluation of their daily instruction. An 
awareness of die Academic Learning Time for an individual student, or the 
profile of Academic Learning Time across students in a classj may help a 
teacher decide when to intervene in an instructional sequence and what to 
chanp. TOs framework p^o^ddes an obser\^ble in-class criterion that can 
even guide minute-to-minute instruction^ decisioni. 

The ALT framework for teacher behaviors categorizes these behaviors 
in terms of the general functions they serve in instmction. Wien specific 
teaching behaviors are analyzed at a molecular level, the impact of each 
behavior is unstable over even relatively smdl changes in context. The 
same behavior may serve different functions, and different behaviors may 
serve the ^me function, depending on the context. This implies that there 
Is no one specific behavior that will be essential to the performance of any 
^ven function. 

This functional view of teaching behavior has considerable implication 
for the practice of teaching. Certainly teachers need a repertoire of specific 
teaching behaviors, but they must also have a good grasp of the functions 
that ipecific behaviors fulfill in a gven context. Teachers who are aware of 
teaching functions will be able to conceptualize their classroom behavior 
In temis of this more general framework. They will be able to evaluate 
what they are doing in terms of instructional functions that should be 
served. Furthermore, they will be able to recopiize what they are not 
doing, m terms of functions that are not served by any of their usual 
behaviors. Hencej where Academic Learning Time provides a basis for 




ditimiliiing whin studants are or are not liaming» the flvi teaching fune- 
tions providi a bads for analyzing ftg stringths and wiaknii^s of the 
mstroctiomd proce^. 



Teaching as Management: Seeking a Workable and 
Dynamic Stance 

To apply the BTOS model to typlcd olassroom initruetion, a broad 
yi$y/ of taaeUng is needed, one that empha^ii th& teacher's role as a 
manger of instruction, Furthennoret it nauat be recognized that this 
management role varies enormoudy as a function of the instructiond 
Mtuation. Ihat is, to tewh one student something, a teacher can learn 
about that student in depth, work directly ^th the student on relevant 
tasks, model dedred beha^or, ^ve constant feedback, and pro^dde timely 
and appropriate explanation, Witfi a class of 30 students, however, this 
kbid of one^to^ne teaching is an inf^quent luxuo^, bistead, the teacher 
must try to plan generally reasonable activities for the different students in 
the class and keep everytiUng moving along as well as p^tible. The teacher 
cannot consder each student in isolation but must manage instruction for 
aU students simultaneoudy, A dynvnic balance between individud and 
poup needs is recpiired. 

The ALT model can be tiiou^t of in terms of two competing goals* 
student enpgement and student hi^ success. Ihe data show that student 
enppment rates are lu^er ^en students have more contact wi^ an 
instructor. Increasing the number of teaching pemonnel (udes, volunteers, 
peer tutors, etc.) is a good ymy to increase the mount of interactive 
instruction a dUld receW^* If the number of personnel (per pupU) is ^ed, 
the amount of interaction can only be increased throu^ increasing the 
amount of group instruction. At the extreme, this means whole class 
in^ruction, which has tfie advmtage of efnciency and e^e of classroom 
behavior management. Hie teacher can pve directions to everyone at once, 
keep an eye on what students are doing, monitor academic perfomiance 
more easily, and give poup feedback, Hus usually results in incr^ed 
student enpgmnent. 

The problem with large poup instruction is dtat the same task is 
seldom appropriate for dl students in the cla^, at least not for ve^.long. 
Hie flndinp for student rate of hi^ success, and related flndinp on 
diagpo^ and prescription, diow importance of matclung tasks to in^ 
dividud studmit needs. Especidly when students are low in entering 
kno^edp or school learning skflls, it is important for them to have 
enou^ suc^e^ftil practice tmie to master the materid. Tbk means tiiat 
Ae instruction^ propam must, to some extent, provide different tasks for 
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different studsnts and allow diffgrint amounts of practice, "hdivid 
ualized" propams emphaaize the goal of appropriate instruction^ conteni 
and pacing for each individual. In the extreme, each student mi^t be 
working on a different task at any point in time, TOerefore, Ae teacher 
cannot g}ve directions or feedback efficiently in person; these functioni 
are uiu^y buflt into the curric^um system. Some students may react tc 
these independent seatwork settinp and the lack of interactive contact by 
being less attentive, 

l^obably, for most classes and mmt teachers in the elementary gradeSi 
it wfil not be suitable to use one organizational pattarn for the entire day. 
lhat is, constant whole class instruction probably not provide suffl^ 
ciendy appropriate content for all students. On the oAer hand, constant 
independent seatwork in indi^dualized propams wfll probably be too 
difflcult to manage efflcientiiy whUe mdntiining enpgement, Smdl group 
work is a useful compromise for individudiEing content in a reasonable 
way, maintaining efficiency and engagement, and prodding social experi- 
ence. Even here, Ae same students wUl probably not flt in the s^e groups 
for all instructional content. Furthermore, it wBl not be possible for all 
students to spend all of their time worldng in poups. The teacher must 
devi^ some workable syitem using different settinp (groupwork^ 
seatwork) for different students in different content areas at different 
times during the day, and keep the ^ole system adaptable to changes in 
student needs during the year. 

In sum I the teacher must try to balance conflicting goals, taldng into 
account the needs of Ae cla^ as a whole, as well as the needs of individual 
students. There is not one "ri^f' way to orpnize the instructional pro^ 
pam. Different approaches have different assets and liabilities. By keeping 
in mmd the Joint goal of student attention and hi^ student successi the 
teacher can evaluate the current organizational structure and adapt it over 
time. 




2 



Time and 
School Learning 



Pirhaps tfii most important eontribution of tha Be^ning Tficher 
E\^uttion Study is tfii dtvilopmtnt of tiia eoneapt of Acadimie Liaming 
Timi and the study of its ralation^p to oAer important tdueationil 
variables. 

Thi BTES notion of Acadmnio Learning Timi was influenced by the 
theoretical work of Carroll (1963), Bloom (1976), and Wiliy and Har- 
niachfipr (1974), but it reprtsents an advanaament ovar these earUar 
thaorias, OTES fmdnp on aUoeated tuna and enpgad time, dtiiou^ 
darivad from a stronger and mora sopWstiaated data bases are sutetuidaUy 
to agraam^t with aarUer rasaareh* The BUS proiddes tha first a\ddanQa 
on the ralationship betwaan adUevemant and ALT, tha simultanaous oc- 
cunanoe of aUocatad tima, engapd timtj and suecess rata. 

This ahaptar provides a summMy of tha work of CarroUs Blowii, and 
WUey and Harnisahfagerp which has lad to increaiad interest in time as a 
vuiibla in school lamming. Next, flndinp on aUocatad time and anpged 
time from fta BIBS and from previous rasaarah are compared. Finallyp it 
presants BUS ftidtap on ALT. 

llieoreticd Work Riladng Tima to School Learning 

Over a century ago, educators recogiized tha importMiaa of time to 
learnbig in tfia schools and aanied out mwy descriptiva studfei d^lpiad 
to datarmina how school time was bemg dlocated to different subjects and 
how time allocation wried from s^ool to s^ool. Concern for ways to 
make mo^ afQcient use of school time has dso b^n widaipraad among 
edu(^tors for at least 60 yaa^. A report by Thompson (1^1 S) docum^ted 
Ae fact that there was much intarast in the topic of more effioiant use of 
school tone around flia turn of tha c^tuty* T^ompon re^awad proems 
fliat attempted to m^a batter usa of school time. Many were assantially 
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administrative, such as regrouping of the school years to include junior 
hl^ school, modification of p-atog and promotion practices, and re- 
arrangiment and iUmtaation of subject matter. Some progrms provided 
extra work time for weaker pupils in afterschool classes^ specid closes, 
and lummer schools, anticipating Bloom's emphasis on extra leaming time 
and teacher help in mastery programs. Other stratepas included changes in 
. instructional procedures, such as assipiments with the degree of difficulty 
adjusted to Ae age md experiince of the child. This attention to the 
difficulty of assipiments anticipated an important element in the BTES 
modeh 

Finally, Thompson discussed various expeiimentd programs in teacher 
education and stated, "Teacher-training institutions are senoudy, and as 
never before^ considering just what goes into the make-up of the successfiU 
teacher'* ^age 33). He pointed out that many educator of his period 
conside^d the teacher to be the key to efficient use of school time, 
Thompson listed the following means of achieving more efficient use of 
time and more effective pupU learning: better 'condition' of pupUs; 
(2) more definite, attractive, and immediate, as well as distant, go^; (3) a 
course of study more pertinent in content and more psycholopcd in 
sequence; (4) wiser, more tactfuj, and more human teachers; (5) a student- 
body more devoted and industrious as well as cheerful; (6) a complete 
elimination or minimization of distractions; (7) more timdy be^nninp in 
all activities; (8) more industrious prosecution of work; (9) keener compe- 
tition of the pupil, with himself and with others; (10) saner refreshment 
and reanimation of pupils'' (pages 35=36). lliompson's list was in some 
ways surprisin^y modernj anticipating some of tfie later theoretical work 
such as Ginott (1972) and Gordon (1970), as well as including such 
modern concepts as framing objectives, increasing relevance, and reducing 
tranMtion time. 



The Carroll Model 

Carroll's article (1963) on a model of school leaming is one of the 
earliest fomiulations tiiat fits enpged time into a model for cognitive 
learning in the school setting. He points out that the time needed for a 
pven pupil to learn a gven concept Siems to relate to five factors. TTiese 
are: 

L Aptitudi-the amount of time an individ^^needs to learn a pven 
tadc under optimal Instruction^ conditions. 
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2, Ability— to underitand instruction, 

3* Pers^iranei-the amount of time the indi^dual is willing to en- 
g^e ietivily in liaming, 

4. Opportunity to liam-the timt allowed for leamlng. 

5. Qudity of initrUGtion--thi depae to which instruction is pra- 
sented so as not to require additional time for m^tety beyond 
that required by ttie aptitude of the learner. 

Carroll reduces the^ five variables into the formula: 

Depee of Learning- f /tima actuaUy spent\ 
I time needed i 

He discusses the difference betw^n opportunity to learn, which is the 
time the teacher or school system allocates to a given learning task, and 
engaged time, the time a pven pupil is actively involved in leamin| related 
to the task* Carroll also points out that it would be desirabla to determine 
the intaractions of the Ave variables in the modeL The two variables that 
are extemd to tha leamerj opportunity to laam and quality of instruction, 
seem to offer the most promise for experimental manipulation. Of these,, 
opportunity to learn is a much more clear =cut and easily undarstood vari- 
able than quality of instruction, which Carroll acfaiowledgas to be 
"eluave." Unfortunately, it is neariy as elusive today as it was 1 5 years ago 
when Carroll*s article was published, althou^ both Bloom (1976) and the 
BTES translate Ae concept into a number of specific elements* 

Carroll also includes the idea of t^k difficulty in hfe model He points 
out that the overachiever, ha^ng yeater perseverance, masters more of the 
ea^ taskSj tasks within the range of his aptitude, than does a student of 
average perseverance* 

In discussing future r^earch, Carroll mentions the desirability of at- 
tempting to provide a generd way of measuring opportunity to learn, 
which he defines as the actual time avulable to individual students to learn 
in view of the pacing of instruction. Later in this chapter we wfll see that 
this research neadj discussed by Carroll 15 years ago, has been better mat 
by the BTES than by any previous research located by this author. 

There some research to support parts of the CarroU modeL For 
exmple, a study by Hymel and Gmnm (1977) was desipied to test the 
various elements in Ae Canoll modeL The authors deflhed quiJity of 
instruction in terms of the use of mastety learning strategy and found that 
a randomly assiped mastety learning group exceeded tiie control group in 
achievement at the .001 levd, CarroU (1974) has also done some work to 
test his model aplnst research data. 



Timt To Uif n 



The Bloom Model 

To a peat extent. Bloom's modil of school learning builds on Carroirs 
idias, and from these ideas he has built a more complete and specific 
modeL Bloom and his students have also conducted a substantid research 
propam and have careftiUy fitted the research of odiers into an element- 
by-element test of the Bloom model (Bloom, 1976). 

Bloom (1974) cites several international studies to illustrate that 
measures of time in school, of themselves^ provide only a rough indicator 
of student achievement. Using acliievement in the U^est achieving devel- 
oped nations as basej an average student in a developing nation has ob- 
tained about 6 years of learning in 12 years of schooling, and an average 
student in a low-scoring developed nation has attained 8 years of learning 
in 12 years. In studies published in the mid-1950's (Bloom, 1956; Bloom 
and Statier, 1957), Bloom compared the achievement of students in 48 
States at the end of 12 years of schooling. Wien we use the mean 12th- 
year achievement of students in the highest scoring State as a base, tiie 
average student in the lowest scoring State completes only 8 years of 
education in 12 years of sdiooling, Tlie \dew that allocated time is not 
hi^y related to achievement is supported by many of the studies of time 
allocated to school subjects, which have usually found low correlation 
between this variable and achievement (Rosenshinej 1978). 

Even thou^ allocated time is not hi^y related to achievement. Bloom 
beUeves that more refined measures of learning time are of major impor- 
tance* By establishing time as tiie centrd variable in school learning, 
Bloom believes that Carroll produced a major shift in our thinWng about 
education, Altiiough time has been a centr^ variable in laboratory studies 
of human lemitog for the past century, it has only recently become an 
important variable in school-based studies of learning. 

In discussing mastery learning, Bloom emphasizes that simple alloca- 
tions of the same amount of time to each pupil will not bring about 
mastery of ttie learned content for many pupUs. ^ta developed by Glaser 
(1968) and Atktaon (1968) surest that the slowest 5 percent of learners 
take about 5 times as long to reach any ^ven criterion of mastery as do 
the fastest 5 percent of leamers. However, Bloom states that where time 
and help are provided to dower students, and these students are motivated 
to use the time and help available, 90 percent or more flndly reach the 
learning criteria set in mastery learning studies. A number of studies of 
mastery learning (Block, 1971; Peterson, 1972) provide evidence that 
mastery learning procedures typically bring about 80 percent of students 
to a learning criterion usually attained by only about 20 percent. ITiis 
additional learning is achieved at a cost of 10 to{20 percent additional 
learning time. 
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Affagtiva outgamas 



Quality of 
instrugtion 

Source: Reproduead with pirmiMion of Aa publishar from B.S. Bloonip Human 
OtmmHstics and Schooi Learning, © M^rtw-Hill, 31976, 

In Bloom's school learning modil (1974, 1976), thare ara three major 
factors that mfluance aohlevement Mid on-task tima. Hie flrst two ara 
eopiitive entry bahaviors and aff^tive entry chmcteristics, the previous 
learnings motivation, and interest a student brings to the task, 

He third variable, quality of instruction, is tfie degree to which the 
proce^ employed by the teacher in the origind instruction, feedback, and 
corrective measures is appropriate to the needs of the learner* to develop- 
ing an operational deftiition of quality of instruction. Bloom (1976) em- 
phamzes four major elements* lliese are: 

h Cues-instruction to the learner as to what is to be learned and 
what he is to do in fte laaming pre jess* From his review of 
rale vent research, Bloom estimates that quality of cues accounts 
for about 14 percent of the variance in achievement. 
% Reinforcement^ -based on the studies dating witfi poup rein- 
forcemant in Ae classroom. Bloom estimates that reinforcement 
accounts for about 6 percent of achievement variance, JTUs is 
probably an underestimate* He emphasizes the need for studies 
relating reinforcemant of individuds to their adiiavement. 
3. Participation— active participation in tha learning situation is es- 
sential to learning. Bloom concludes from his summary of about 
20 studies tiiat aOT>roxtaately 20 percent of the indi^dual 
student's variance in achievem^t is accounted for by his particl* 
pation in the da^room learning proce^. 



iRainfefeement refers to imfcruationd Msavior fXm tands to ineriasa laamar 
bihavlor ralatid to tehia^mant, mch as taachw attention and pmiie. 
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4, Fiedback/cprrectivei-fgedbick providii the leamir ipeciflc in- 
formation on his propiii; correctives usually take thi form of 
altimative cues and additional timg and pnctice* In his re^dew of 
ritovant risgMch, Bloom reports a median corrdation between 
achievement and use of regular feedback and corrective proce- 
dures of about ,47. 

Bloom estimatei Aat Ae combined effect of the four variablei he includes 
in quality of instruction probably account for 25 to 40 percent of achieve- 
ment variance, and possibly more* He emphasizes tiie importance of par* 
ticipationi which is essentially anonymous mtii enpged time as used in 
theBTES. 

A sAematic representation of Bloom's model (Bloom, 1976) shows 
how the variables cognitive entty behaviorSj affective entry characteristics^ 
and qudity of instmction relate to learning outcomes (figure 2 4)* Bloom 
reports that multl^e correlations between achievement and tfie three vari- 
ables are typic^y .85 or hi^er when corrected for attenuation. He flndt 
that correlations between these three variables and time on mk are about 
.75 when corrected for attenuation. 



The Wihy-HarnUchfeger Model 

Among the most useful Uieoreticd formdations concerned witti school 
learnmg since Carroll's 1963 model is the work of WUey and Itemischfeger 
(1974, 1976). Like other researchers who have worked in this fields the 
auAors pomt out the futUiQ? of using standardized achievement tests as a 
criterion in tiie face of increasing evidence that tiiere are tremendous 
differences in tiie curriculums covered in different cla^rooms and in the 
amount of time devoted to various aspects of the curriculum. Uke Ganoll 
and Blooms Aey condder time to be the concept ftat is bade to the 
construction of tfieir model for the teaching-learning proca^. 

In tiie Wiley-Hamischfeger O^fl) model, as in CarroU's formulation, 
pupfl achievement is directly determined by only two variables: ^e total 
time needed by a ^ven pupil to learn a task Md the total time the pupU 
actually s^nds on this task. ThA influence of aU other variables such m 
pupil chaMCteristicSj instructional quality, and teacher characteristics is 
mediated through tfiese two basic time factors. There are enormous varia- 
tions in the total dlocated time, tiie learning time needed by different 
pupils, and the anounts of aUocated time actively spent in learmng. There 
is also a pe^t difference between tiie amount of time nomindly allocated 
to schooling and the active learning time for a given pupU* Allocated time is 
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reducid by a pm many v^Mis rangini dl tha my from sueh In- 
friquent ivinti ^ parent boy^tts or teadiar strikes to sudi day*to-day 
oecumnQi^ as pupfl motii^tion. Such vtriabtes as pupil tptitudi, elwity of 
ttacher Instructions, and diffleiflty level of thi aMiped taik are alsp con- 
ddemd in the model, 

' Figure 2.2 flluitmtes the W-H model and diom how pupil and teacher 
edibles influ^ce needed learning time and active learning time. It can be 
seen that the W-H theoreticd model movei wdl beyond the ^riables of 
average dmiy attendmee, len^ of school dayp and Imgii of school year, 
^Wdi Wfley had explored in his reanalyds of the Coleman report data 



F^ure 2X individual InMu^onal Eaqposure and Achieviment 



Pi. Itoimil quantity of idiooUiig ^ 




Spy/^/ RtptodUGed with pf nnlislpii from DM. WUey and A. Hamiichfiger, Ex- 
^oden of a myihi QuaU^ of sdiooilni md ^poim to insMction, m^Jor eduea- 
tfond vehidef. EAimHoml Rmmrdtir 3:4 (April 1974): 742. @ 1974, Ameri^ 
Education^ Rtsaardi Assodtdon, Wa^ington« D.C. 
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CWUiy, 1973), and which will b© discussid here in i later saetion. It is on 
tiUs more sophiiticatid analysis of naidid liiming timi and activi learning 
time that the WTBS coneapt for acadimic liaming time wg% built. 

In ilaborating their model, Wilsy and Harnischftger (1976) dijcuss a 
number of fetors that dan influanci tha total active learning time for a 
given pupfl. Among theie broad faetors are taadier planning md prepara- 
tion, tha nature of tha leaning settinp, and tiaehar eapabflities. They 
view taachar eapabilitias in the contaxt of four major catag^ries, Th^ first 
is planning, which involves forming datailed spaciflcations and guidelines 
for olSMroom acti\1ties, Tfca lacondj implementation, is concamad with 
tha taiaher's capacity to trmdate plans into classroom stratagias and 
activities. Inducmg refers to the ability of tha teacher to moti^ta pupUs 
and increase Uieir active learning and task involvement, Finaliy, the 
teacher naads communication skills to facBitata pupil laarning* 

They dso expand tha concept of Teacher Charactaristics (figure 2.2) to 
mcluda "motivatings," -^momtorinp," "communicatingi" and "desip, 
paca^ ^d saquance of learning." Curriculum (fl^ra 2,2) is called "learning 
settinp'* in thair later work and is broken into "curriculumSi" "pouping 
strate^as" "Jdnd of teacher supenrtslon " and "taachar managerial 
actiidties." 

A study by Kidder and his colleagues (1975), carried out concurrently 
vsddi some of Wiley and Harnischfager's work, providai data on some of 
the variablas included in the W-H modaL The sample consisted of approxi- 
mately 2,500 pupils in the fourth, fifth, and sixth grades in four school 
diatricts, TTia quantity of instruction in tha study was aitimated from 
intarviaws with teachers, aides, md other pefsoni involved Erectly with 
the pupfls. Qudity of instruction, whidi is considered in all three of the 
learning models we have discussed, was Mso maasured. However, tha 
measures of quality of instruction were somewhat limited, consisting 
mainly of information on the materials utUiEad in the reading instructiOHi 
on tha instructional mode, and on the type of initructiond staff. Most of 
these data were collected throu^ inter^ews. At bast, this must be re- 
prded as a limited basis for estimating quality of instruction, iMthou^ 
some significant correlations were obtained between time variables, such as 
minutes par year the taachar spent in whole ^oup instruction and minutes 
of individual help by the taachar, correlations were ganeraUy below ,30 
and were not condstent from district to district. However, multiple conra- 
lations uring pupfl ability, teacher and school charactaristics, and time 
variables to predict pupil achievemant ranged from ,87 to .90 for the four 
districts, with time variablas maWng signiflcant contributions to the 
multipla correlation in three districts, IWs study may be regarded as pro- 
dding limited su^ort for the W-H modal, dthough the methods for esti- 
mattag both quantity and quality of instruction were weak. 
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The Academic Leamtng Time Model ofaassroom Instruction^ 

Urn BTES mv^tiptors bapn by ixaminini tht amount of time avafl- 
abte during sAool for a studint to work in m partleiUar subjeot area* IWs 
lit of eoursa, the old conaipt of aDooatid tima %dth the teach§r doing the 
alloaation in tWi itudy. Enpged time, wUeh had baen explored m pre- 
vious work, was also part of the foundation upon wWdi the inv^tiptors 
buflt. From thg^ be^mnp, the coneept of learning time developed, 
Acadeniic Leamuig Tfane (ALT) Is time spmit by a student enpged in a 
task on whieh fiw mon art made and where tha task Is dirigtly relevant 
to an acadimic outgone, Thm, thi bade components of ALT are allocated 
tlme^ student engagementp sucGess rate, and task relevance to m aeademic 
outeome. 

Let us briefly review eaeh of the^ eomponenti. AUoeated time is the 
time detipated by the teaser for a particular learning task, Enpged time 
is the time that the student is actuiUy involved in the pvf n learning 
activity. Success rate is demgried to reflect the degree to wWch the student 
correctly processes and understands the learning task, success rate 
refers to atuations where the student has a good tmdemanding of Ae t^k 
and makes only occasional careless errors. Low success rate describes the 
dtuation where the student does not understand the task and mak^ cor- 
rect responses at about the chance leveL Medium success rate involve a 
partial knowledge of the atuatlon where the student understands enou^ 
to produce some correct responses but dso commits mon due to limita- 
tions and his understanding, 

OripiaUy, the ALT model hypothesiied tiiat medium success rate 
would be associated with masmum learning. However^ preliminary data 
malyds indicated that high suce^ rate was podtivdy related to achieve- 
ment gain ^^Me medium success rate was not* TTierefore, the deftiition of 
ALT was altered to refer to time students spend learning tasks at a 
success rate rather %hm at a medium success rate. Hie invastiptors 
hypotheKzed that a low suwess rate would always be detrimental to 
leaming. 

Task relevance refera to the obvious fact that if student adWevement is 
to be employed m a criterion, tfie leamuig acti^ties must be limited to 
those content categories that are covered on the aAievement measure. 

In addition to the components of Acadenuc Leanibig Tune, the investi- 
ptors hypofliesiied an instructional proce^ they beUeve ^ residt in 



^TTie t^m "modtl" !§ used h^e to mmn a mhrnn^ for ywyinng IniMetioiL It 
^mild not bi aronifd that tiie BT^ pioidd#i a d^ription of a "modd teacher"' or 
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mcraa^s in ALT. TWi proce^ mcludes diaposis, prescription^ presanta- 
Uons monitoring and faedback. Some of tha instructional functions such as 
monitoring and ftadbaGk ara dosaly related to conoepts discuisad in 
aarUer modali such as Bloom's* Classroom anvironment, including such 
dimenaoni as anthuMaan, warmth^ cooperation, and task orientation are 
also conadared in tha BTES as potential factors influancing ALT* 

Wien we aximine the three modals of school learning that preceded toe 
ItolJnning Teacher Evaluation Study, wa can see that eadi has contributed 
important ideas to the ALT modal. Howevefp tha ALT model goes beyond 
any of its pradecassors in specifying the variables that influence school 
acWavement. A major advantage of the ALT model as compared ^th 
learning models such as those proposed by Wiley and Hami^hfapr, 
CarroU, and Bloom is that eadi component in tha ALT model is concrete 
and quantiflabla* In contrast, a variable such m "qudity of instruction," 
which is incorporated into all three previous models, is complex and diffi- 
cult to define operationally. Althou^ partial definitions of quality of 
instruction can be developed, we have pfobably identified very few of the 
critical variables that datarmine instructional effectiveness. 

Parhapi an even mora important contribution, however, than the theo- 
retical davelopmant of the ALT model is the process employed to validate 
tha modal in actud classrooms* Some evidence has been accumulated over 
the years to support the Wiley-Hamischfegir, CarroU, and Bloom models 
of school learning, but none of these modds has been tested by research of 
the scope and ma^tude of the Banning Teadier Evaluation Study. Hie 
BTES investigators tystematicaUy developed aid carried out a research 
program dasiped to test every element in their theoretical modaL The 
result of this research is 14 major flndings that support virtually eveiy 
element in the ALT model of sdiool learning. ITiree of these findinp are 
directly concerned with time as it relates to academic achievement; they 
ded mth allocated timej engaged time, and academic learning time. In the 
remainder of this chapter, we will revdew previous research for each of 
these major time variables and wUl relate this work to tiie fmdinp of the 
BTES project. We wUl see that in each of these areas the BTES investi- 
ptors have pthered evidence to support tiieir mstructional model and 
advance our understanding of the function of time in school learning. 

R^aarch on Allocated Time 

Early Studies of Allocated Time 

Of the time concepts that eventually became part of ALT, allocated 
time was the first that was explored by educational researdiars. Early 
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^udiis of aBocated tlma coUectgd disoriptivg data on tha tima devotid to 
diffirent subjeot aitai by diffcrint school dtetricts, Mann (1928) searched 
school riGords datmg baek to 1828 and in 1926, conducted a survgy of 
tlmi aDocations in 444 ^erican cities, TTie fiM spedflc time require- 
mints reported by Mann were found in reports concerning the public 
schooh of Boiton in 1845, TTie flrit complete time allocation by subject 
found by Mann was printed in the report of the Cleveland, OUOj Bowd of 
Education for the year 1 855-56. 

Mann was able to locate aBocated time reports : six cities from 1862 
to 1972 (table 2,1). Comparable data from m c :ies were gathered by 
Payne in 1904, 

A study by Holmes (1915) ^s the m^t comprehensive survey of time 
aUocations in public elemental schools prior to Mann*s survey (table 2 J). 
Thfe report deals ^th the distribution of time by subject matter md 
pades in the elementaiy^hools of SO American citi^ representing aU 
sections of the United States, Hohnes cautions that official tables of 
allotted time do not represent the actual distribution of time in any class^ 
room. He states: "Eventuafly our itandards must be based on the study of 
time actually consumed; but even then we AbU have to allow for obstacles 
and interruptions . , r (p. 22). 'mui, Hohnes clearly distinguishes between 
allocated time and enpged time-a distinction pven mudi attention in the 
models of school learning we have reviewed. 

It is interesting to note that Holmes considered the outstanding finding 
of his surv^ to be the great divergence in time allocation among the 
elementary school subjects, Hus tremendous wiabflity in allocated time 
has emerged in every study in this field over the past 60 years. If wiythini, 
the variability found in the BTES analysts is even ^eater than reported by 
previous investigators^ su^esting that huge variation in allocated time is a 
fairly permanent fact of Ufe in American pubUc elemental sdiools. We 
will see that Wiley*! (1973) analysis makes this liability an extremely 
important factor in understanding achievement difference, 

A precise comparison of time dlocations between the BTES study and 
earlier studies such as those by ftyne (1904X Mann (1926), and Holmes 
(1915) is not posdble* However, the authors of all of these studies define 
their categories clo^Iy enough so the data in table 2*1 provide what we 
believe to be a fairly accurate comparison. Deflnltions for "readmg md 
knpiage arts/* "mtiiematics" and **other academics'* appear to be very 
amilar. However, some difBciUty arises in comparing data in the "non- 
academic^ md **break" categories. Hie BTOS lists structured physical edu- 
cation as "nonacadenUc" aid unstructured phyrfcal educatJon as "break" 
time. A predie division is not posrible with the earlier data, although the 
deflnition of physical eduoation in the Mann sunrey definitely refe^ to 
itnictured acti\dty and has been classified as "nonacademlc- - time. Least 
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Tabla 2 J. Titiia AU^attoni in Minute per Day Actom the Daoades 



Subject areas 



Gradi 5 



^§62-72 data for 
^ 6 dties (Mtnn) 


i* 
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4 


5 
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4 
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143 


50 


33 


39 


23 


16 


146 


61 


40 


35 


24 


18 


l904iU]rveyof6 
Idtifs &syne) 

1914 piivey of 50 
Icitlts (Hoimei) 


. 157 


41 


15 


44 


23 


7 


119 


53 


60 


41 


21 


7 


136 


30 


24 


83 


38 


12 


109 


45 


63 


69 


34 


10 


1926fUiviy of 444 
1^ cities (Mann) 


137 


29 


19 


69 


22 


11 


108 


43 


59 


73 


19 


10 


BIIS A^B period 


85 


37 


9 


54 


76 


45 


113 


41 


25 


52 


30 


46 


BTES B>C period 


88 


36 


8 


55 


75 


44 


110 


44 


17 


65 


77 
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i ^Subj^t Affts: Data from MUer studies have been orggniied to flt BTES categaries as mu€h as pos^bia. 

; L Reading and lan^age arts. In tiie eafUer studies this t^^ledly ineiudes reading, language, ipellingi and penmanshJp* 

^ , 2, Mathematics. 

' 3i Other academies. In eirliar studies thU ineludas geography, liistary, Mid selenee. 
'\ ' 4, Nonacademie. Includes sueh actintiei as muila, ir^ stnietured phydeal educatlan. 

5, Break. Includes recess and unstmcturad phydey education (also includes lunch pariad in BTES study). 

6, Management, wilt, ^d transition. Includes opening exercises in the earlier studies. 
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comp^able earUar resiarch is the BTES categoiy, which includes 
managemant, wait timi, and tmnsitions. ITie only similar categoiy in the 
earUer studlei is '^opening exercises/' largely a management aGtivity similar 
to today's homeroom period. With these limitations in mind, perhaps the 
most impressive difference in second grade time allocations between the 
eariy studies and 1976=79 BTES data is that, in the early studies, more 
time was devoted to reading and language arts ai\d ^^other academJc sub- 
jects'' and less time was scheduled for breaks. Grade five time allocations 
for reading and language arts and mathematics are closely comparable 
between the two periods. Again, **Qther academic subjects'* were allocated 
much more time and **breaks" much less time in the schools during the 
1 900-26 period 

TTie variability in allocated time is ve^ large for aU studies we have 
located. However, these figures are not entirely comparable since in the 
BTES the variability is measured from classroom to classroom, while in the 
earlier studies variability was measured from school district to school dis-' 
trict. In Holmes' study, reading, language arts, a_nd arithmetic took up 
about 70 percent of time spent strictly in classwork. He also found that 
the amount of time allocated to these subjects was more variable than for 
any other subjects in the curriculum. For example, in grade two, there was 
a range of 120 to 374 houm in the time allocated to second'-grade reading 
and 33 to 190 hours in time allocated to second-grade arithmetic. 

Mann's survey (1928) found the same huge variations in time allocation 
that have been reported in every study we have located in this area. For 
example, he found that the school ^stem giving the greatest emphasis to 
reading allocated nearly 12 times as much time to that subject as the 
school system ^ving the least emphasis. TTiis ratio was even larger for some 
other academic subjects. For example, spelling was allocated 48 times as 
much time in the district ^ving it the most emphasis as in the district 
pving it the least. The ratio was 109 for literature, and 144 for nature 
study and elementaiy science. Even in arithmetic, where the curriculum 
has typically been more standardized^ some school systems gave 4.4 times 
as much time to this subject as others. As large as some of these differ- 
ences are, when we remember that Marm's data were based on school 
district time aaocations, we can be certain that the variations among indi» 
^ddual classrooms would be even peater. 

At the time of Mann's study, some research had already been done to 
determine the optimum time per day to be allotted to penmanship and 
spelling. Little research was available at that time on optimum times to be 
allocated to other subject areas. In a statement that seems surprisingly up 
to date, Mann concludes: 
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Optimym time aUotments can be astabUihed only after eduratioiial 
research has faulted in^ 

1 . The determination on the part of curriculum makers of a definite 
list of specific objectives and desirable outcomes for each 
subject which should be attained by pupils of the elementary 
pades^ 

2. The determinatiDr of the quantity, quality, and kind of edu^* 
tional experienoes ne^ssary to bisure achievement of the specific 
objectives. 

3. The determination of the most effective methods of instruction 
to be employed in presenting these edu^tiond experiences in 
order to wcure the expected knowledge, skills, attitudes, and 
ideals (p. 150). 



Allocated Time and Achievement 

The Wiley-Harnischfager model for tehool learning had its beginning 
with WiJey*s reanalysis of some of the data from the Coleman report^ 
Equality of Educational Opportunity. This major study of the effects of 
schooling was earrled out by Coleman and his assoeiates in 1966. Although 
Coleman gathered data on school attendance, he did not analyze relation- 
ships between attendance and achievement. Wiley (1973) explored a 
number of speciflc deficiencies in Coleman's oripnal analysis and in the 
reanalysis of the data carried out by Jencks and his colleagues {1972). 
Wiley then went on to reanalyze data obtained from the Detroit metro* 
poUtan area sixth-grade sample of Coleman's Equality of Educational 
Opportunity survey, focusing on quantity of schooling and measures of 
verbal ability, reading comprehension^ and mathematics achievement. 
Based on the Coleman data, Wiley predicted the effects of various changes 
in quantity of schooling on the three aforementioned variables. He pre- 
dicted that increasing the number of days in the school year by 5.5 per- 
cent would lead to achievement increases ranpni from 8,33 to 1642 
percent Increasing the hours of the school day from 5 to 5.5 or from 5.5 
to 6 similarly would lead to substantial percentage increases in the three 
achievement measures. Finally, increasing the average attendance from 88 
percent to 95 percent would bring about gains ranging from 11.75 to 23 
percent on the achievement variable. Hie overall effect of raising the days 
of the school year by 10 days, the hours in the school day to 6, and the 
ADA to 95 percent would be to bring about a 24.34 percent increase in 
the quantity of schooling. It wiU be noted, however, that this increase is 
predicted to lead to an increase of 33.58 percent in verbal ability, 65,5 
percent in reading comprehension^ and 33.92 percent in mathematics 
achievement. When we consider that these rough estimates of quantity of 
schooling do not consider many of the more subtle variables such bb 
quality of teaching, the actual time pupils are engaged in the study of 
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sptdfic subjects, and the amount of wait time and transition time in the 
classroom, these predicted achievement gains are impressive. Wfley's results 
present a ve^ strong case to support his contention that quantity of 
schooling is an extremely powerful variable in determining pupil 
achievement. 

It is important to note that in every case the gain in achievement 
exceeds the increa^ in quantity of schooling. It should be remembered 
that these flgures are predictions based on the Detroit data and do not 
actually reflect changes that occurred in achievement when the changes in 
quantity of schooUng were made. 

Wiley points out that a number of questions regarding his analysis need 
further explanation. He questions whether it is reasonable to expect that a 
24 percent increase in the quantity of schooling should result in a 65 
percent gain in reading comprehension. He mentions that the analysis 
could have been ineffective in controlling for pupil background. It is also 
possible that the quantity of schooling in a pven school could be stable 
over yean and, therefore, the analysis could reflect the impact of more 
than 1 year on pupil achievement. Wiley has followed up his reanalysis of 
Coleman data with additional comparisons that tend to support the inipor- 
tance of quantity of schooling to achievement. 

WUey calculated the average number of hours of schooling for pupUs in 
schools in his Detroit sample by multiplying average daily attendance by 
the number of hours in the school day and by the number of days in the 
school year. He found that schooUng ranged from 710 to 1,150 hours=a 
tremendous difference when we consider that ^ schools were drawn from 
the same district. 

It should be noted that when Karweit (1976) carried out analyses 
similar to Wiley's on several data sets^ including data from the Coleman 
study, she fafled to frnd the large relationdups between quantity of school- 
ing and achievement that came out of the Wiley analysis. Her results 
generally showed positive, but mailer, relationships than those reported 
by Wiley. However, part of her work used pupil attendance to estimate 
quantity of schooling, a measure that provides a much weaker estimate 
tiian that u^d by Wiley. As Hamischfeger and Wiley (1977) point out, 
replications are needed to determine how large an effect quantity of 
schooling has on achievement. I^ere can hardly be any doubt ^ however, 
that a signiflcant effect is present. 

Certainly a major contribution of the work of Wiley and Harnischfeger 
and other researchers in this area is to correct the false conclusion that 
many have drawn from Coleman's Equality of EducQtioml Opportunity 
report— that schooling has no effect on student learning. A further contri- 
bution has been to alert educational researchers to the importance of time 
in school learning. As Bloom (1973), Rosenshine (1978), and WUey (1973) 
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have pointed out, most major studies of Khool leaming have not indudgd 
measures of student learning time as a variable. 

Anodier reeent itudy of aUoeated time and achievement supports 
Wiley's findings, Nieman and Gastri^t (1975) gathered longitudinal data 
on relationdiips between test scores and tfie amount of time students 
pmicipate in preschool and Mnderprten classes. The study was eoncerned 
with four poupi of pupils: (1) those who had preschool only (about 600 
houri of class time), (2) those who had half-day kindergarten (600 hours), 
(3) those who had ajl-day Idndergarten (1,200 hours), and (4) those who 
had aU-day Wndergarten plus ^preschool (IJOO hours). The results Indi- 
cated that chfldren who attended preschool scored significantly higher on 
achievement measures than those who did not attend. Differences between 
aUniay kindergarten versus half-day kinderprten were si^flcant at the 
.001 level on one of the achievement tests used. ChUdren who had had 
all-day kindergarten plus preschool were significantly hi^er at tiie .01 
level than chfldren with ^»day Idndergarten without preschooL Lack of 
good research design plus the fact that most of the sipificant resists were 
obtained for only one of the several achievement tests used indicate these 
data only provide tentative support for the conclusion that quantity of 
schooling is dpiiflcantly related to achievement. lOie fact, however, that 
these adiievement differences were found across a wide range of different 
dassroorns and methodolo^es is dpiifi^t, ITie nuniber of pupils in- 
volved was large, ranging from 130 to 551 for the four poups. Hie data 
were consistently in the hypothesized direction for all adiievement 
measures, even thou^ results for some measures were not sipiiflcant. 

Schmidt (1978) conducted a recent study dedpied to detennine the 
eff(Mt that quantity of schooling during hi^ school has on student 
achievement in dx subject matter areas. His data were drawn from the 
National Longitudiital Study of the Ei^ School Class of 1972 and in- 
cluded 9,192 students from 725 sdiools. Potential houn of instruction 
were determined for each student in each subject area by multiplyijig the 
number of courses by the number of weeks of instruction per course by 
the length of the class period. Regression analyses were conducted, with 
the indi^dual student as the unit of analysis, using each of three adiieve- 
ment tests as a criterion. 

For the vocabulary achievement test the regression c^fflcients were 
sipiflcant for potential learning time in aU six subjects, but hi^est m 
science and forei^ language classes. Tlie multiple correlation of measures 
of pupil ability, background, and potential leaming time with vocabulary 
achievement was .286, 

For reading achievement, coefficients for all measures of potential 
leaming time except social studies were si^ificant, with the coefficients 
apin hi^est in science and forei^ language, ITie multiple correlation of 
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itiding idUavemint isdth ih§ time, abflity, ind pupfl background ^riables 
was .368, 

The mathemati^ ripemon analpii indicated that of the tlirei adueve- 
mant ireaSj mathimatic^ is moit stron^y influenced by potentiil quantity 
of ^ooUng. Rigmrion coiffldents for potential lianiing time in science, 
foraig^language, and mithemati^ w«e aU large and statisti^y si^fl- 
cant The multipte correlation for learning time, abflity, and background 
viriablai venus matheinato a^evement was .572^ The resits of 
Sctoiidt's work demoimmte that the quantity of sdiooling a student re« 
ceives in school does have a sipiificant effect on academic 

aduevement. 

As one mi^t expect, aUocated time is not as powerfid a variable as 
engaged time, and some of the re^arch udng aU^ated time, such as the 
work of Weldi md Brid^mm (1968) and Guthrie, Martu^, and Siefert 
(1976) has failed to find dgnificant relationshipi with achievement. 

ne BTES Findings on Allocated Time 

Let us now reww the findings of the BTES study \vith regard to 
relationships between located time and a^evement. The investiptors 
concluded that the mnount of time that teachm sBocate to imtmction in 
a partwubr content sTBa is pomtivefy related to achievement in that con- 
tent area. The BTES study differs from previous research on allocated time 
in several important ways. First, mther than collecting information on 
broad content areas such m reading and mathematics, the researchers 
pthered detafled infomiation on highly spedflc topics with^ eadi con- 
tent area* For aximple, in second-grade reading, data were coUected on 
timi aBocated to 26 spedflc content tasks such as decoding short vowels, 
compound words, and oral reading. Second, data were gathered from both 
teaser logs and observer records. In contrast, most earlier researdi relied 
on school or dfetrict records or on teacher recall oifly, and often required 
long^erm rei^, which is likely to be unreliable. Third, the data were 
collected for two time periods, October throu^ December (A-B), and 
J^uary throu^ April thus pro^duig some of the advantages of a 
repUcarion of tlie study. Fourth, data were collected over i relatively long 
rime-6 wae^ durmg Ae A-B ^riod and 17 weeks during the R€ period 
of the study, Findly, teacher log data were recorded dafly by eadi teacher 
on each of that teaser's tarpt students. Obviously indi^dual pupU 
data are mudi more preMe than located time data collected for entire 
^ools or classrooms, as has been the case ^th most of tiie eariier studies* 
It is clear that Ae BTM data are by far Ae most detailed and compre- 
henave mformation ever collected on the relaUonship between dlocated 
^e and a^evement. 
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Table 2.2 presints the results of analyses of allocated time and enp|e- 
ment rate in reading and mathematics at grades two and five duririg the 
January through April (B-C) period. Regression analyses of allocated time 
and student engagement rates as separate variables involved predietini 
postachievement from preachievement, allocated time^ and percent of time 
student was engaged in relevant academic work. The proportion of residual 
variance in the postachievement measure that was accounted for by allO'^ 
cated time is reported for each content categOQ^. Residual variance can be 
thought of as a rou^ estimate of student "learning," where learning is the 
difference between a student's achievement score on the posttest and that 
which one would have expected knovdng only his or her score on the 
pretests 

In table 2.2, the proportion of residual variance accounted for by allo- 
cated time is ^ven only when the significance of that effect was at or 
below the .10 level. The signiflcance level and the sign of the effect are 
given. The proportion variance in the posttests accounted for by the pre- 
tests is also pven. 

Positive results were obtained for allocated time for 6 of the 17 second- 
grade content areas and 5 of the 12 flfth-grade content areas. Most of the 
significant relationships between achievement and allocated time are not 
large, accounting for from 3 to 6 percent of the residual achievement 
variance. TTie data can be thought of as falling into four quadrants: 
second-grade reading, second-grade mathematicSj flfth-pade reading, and 
fifth-grade maAematies. Four of the flndinpj which appear in three of the 
grade-subject quadrants, are impressive^ accounting for 10 to 24 percent 
f the residud variance. "Die results are hi^y consistent, with si^flcant 
positive effects being found in all quadrants. In no case did a dgniflcant 
negative effect occur. Where the effect was largest, fractions at grade five, 
allocated time accounted for 24 percent of the residual variance. 

Tile residual variances found in the BTES analysis probably come close 
to the maximum that can be accounted for by allocated time. It will be 
recalled that allocated time does not take into account the time that the 
individual pupfl is actually engaged in relevant school work and must 
therefore always be, by itself, a rather crude estimate of pupil work in- 
volvement. However, we have seen that even such basic time variables as 
attendance rates, length of school day, length of school year, and pre- 
school attendance can have important effects on achievement. When we 
combine the precise outcomes of BTES with Schmidt's (1978) regression 

analysis and the predictions of the effects of increasing allocated time that 
emerged from Wiley*s (1973) work, we must conclude that allocated time 
is a powerful tool that teachers and administrators can use to increase 
pupil achievement. 
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One would expect that when thesf basic aUocatid time variables arc 
supplemented with mora sophiiticated variables such as engagement rate 
and succe^ ratti we dioiUd be able to account for a substantial amount of 
pupfl a^evement* In the remainder of this chapter w§ wiU explore e^- 
dence related to this expectation. 

Opportunity to Learn and Achievement 

Since the development of CarroU's theoretical model, a number of in» 
vestiptors have related teacher ^timates of opportunity to learn ^th 
pupil achievement* Researchers have i^ed a ^riety of methods of esti- 
mating this variable. Opportunity to learn is a more sophisticated concept 
than allocated time since it deals with the coverage of speciflc academic 
content (usually related to test items) rather than dealing only with the 
time aUocated to broadly defined content areas such as reading or mathe* 
matics. Althou^ the content validity problem has not been adequately 
controlled in most studies, Rosenshine (1978) reports that of the 14 
studies he located, aU except 1 reported dpiiflcant relationships between 
opportunity to learn and student achievement. We wUl briefly review four 
studies that deflned opportunity to learn in terms of teacher estimates of 
content coverage dnce thii appears to be the most precise measure of the 
opportumty-to-leam concept (Husenj 1967; Comber and KeeveSj 1973; 
Chang and Raths, 1971; Borg, 1978), 

In a study comparing coverage of basic ildlls content in seven **lower 
class" and seven "middle class'* schoolss Chang and Raths (1971) iden- 
tified 20 items from the Iowa Test of Basic Sldlls that discriminated be- 
tween the two kinds of schools in terms of correct responses ^d 20 items 
t that did not discriminate, A questionnaire was then developed in which 
teachers indicated on a four-point scale the degree they had emphasized 
the content of each item, TTie mean emphasis score for "middle class" 
schools was sipiiflcantly higher than for 'lower class** schools for the 
discriminating items, but not for the nondiscriminatirig items. Althou^ 
this study had seveml serious ftawSi the results sugpst a relationship be- 
tween opportunity to learn and pupil aduevement. 

In ar. intemational study of ^ience education, Comber and Keeves 
(1973) founds using the school as tiie unit of analysis, that opportunity to 
leam science concepts was sipiiflcantly related to science achievement in 
some countries but not in othem. The average correlation ^s ,20, and 
correlations ranged from +*58 for Scotland to -,11 for Sweden. Wien the 
student was used as the unit of analysis, the correlations ranged from ^.01 
for Japan to ,33 for Scotland^ ^th a mean of .12. hi this study, oppor- 
tunity to leam was calculated for each school by ha\ing science teachers 
meet, discUM each test itemi and estimate what percentage of the students 
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Tabia 2,2. Reptiaons Anilyring tha Effects of AUwatad Tmie and Engagement Rate: 
Analy^s of Resdmg and Mathematks Achievement at Grad^ 2 and 5 During Ae BC Period, Reposing 
Posta^evenient on Pre^hievemant, Allocated Time, and En|agement Rate 



Alioteted tinig8 and engagement rate^ effects 



Content category 
for pQitachievemant, 
preachtevtmenti and 
allocated time 



Proportion 
of varianca 
acDounted 
for by pra- 
achtevemant 



••p<.01 



+ positive 
^ native 



Time 



Eniaga- 
ment 



Time 



Grade 2 (N^ IS9) 



Engage- 
ment 



Total comprehension 


.32 












Decoding blends and 














long vowels 


,49 




«* 


+ 




+ 


Decoding variant consonanti 


.12 




* 






+ 


Deeding complex patterns: 














spelling time 


.47 


* 




+ 




+ 


Word structure: 














mtantegful units 


,49 












Word structure: syllables 








+ 




+ 


Total Reading 


.68 




« 






+ 


Addition and subtraction: 














no regrouping 


.24 












Addition and subtniction: 














speeded test 


.35 


* 


«• 


+ 




+ 


Addition and subtraction: 
with fegrouplng 


M 


« 


• 


+ 


6 


2 

+ 



Unique proportion of 
reiidual wiance^ 



Time 



.03 



.05 



.02 



*03 



Engage- 
ment 



.08 
.02 

.03 



.03 



.04 



.02 



Time k 
engage- 
ment^ 



.09 
.03 

.07 



.08 
.04 



.07 



.04 



ERIC 



Computidooal transfer .32 ' 

Place Yiliia and numenls Al 

Word problems .27 • + + .02 .04 

Money .34 » + + ,04 .04 

Lineir m^fureinent > 19 

Fractions .05 *• + - .10 ,10 

Total mathematics .58 

GmdB5fN^ 122) 

Total word meaning .69 ^ + .15 =15 

Total comprehension »66 •* + ^ .IS .15 

Word stfueture: syUabies »35 

Total reading .77 • • + + M .02 . .06 

Total geometry .12 » + + ,03 ,04 

Total multiplication .33 
Multiplication speed tcsti 

bade facts time .65 • + + .06 .04 .10 

Dtviston .30 

Fractions .28 + + .24 .26 

Computational ^ansfer .58 

Word problems .38 

Total mathemaUes .69 *• + ^ + .06 .06 



^Based on teacher logs, 
b Based on obiervatiQn. 

^This is the proportion of residual vmance ac^unted for uniquely by allotted time or engagement rate* Reiidual variant refers to the 
variance remaining in the postechievement measure after preachievement has been ^'removed** p 
^"nus is the residual variance accounted for by allotted time and engagement rate, including variance **^ared*' among these two variables, m 
Source: Fisher et at (1978, pp. 4-26). 
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who took the test had had an opportunity to learn the concept that the 
item tested. 

In an earlier international study of mathematics (Husen, 1967), a 
similar method was used to estimate teacher coverage, ach teacher was 
asked to estimate what percentage of his or her itudents who took the 
mathematics test had had an opportunity to leam the type of problem 
covered by each test item. A smaU but statlsticaUy signiflcant positive 
correlation was found between test scores and teadier coverage scores. The 
mean correlation acrois 10 countries ranged from .11 to .20 for the four 
populations studied. However, the correlations varied peatly from one 
countty to another- For example, the correlation was .60 for the 13-year- 
old sample in ScotlEnd and -.03 for tlif same sample in Sweden. 

Althou^ these three studies generally report positive relationship be- 
tween teacher coverage and achievement, many of these relationihips are 
smaller than we might have expected. One possible reason for this is the 
procedure for me^uring opportunity to learn. In the study by Chang and 
Ratlis (1971), teachers were estimating coverage o^^r an entire school year 
and made their estimate a fuU ye^ after the target pupils had left their 
classrooms. Under these conditions, there must be serious doubts about 
the accuracy of teachers' recollections. Similarly, in the two intemationd 
studies, teachers were asked to estimate what percentage of students had 
had an opportunity to leam the content of each item at any time during 
their years at the ^hool in question. Furtliermore, in the study reported 
by Comber and Keeves (1973), since the teachers worked together in 
arriving at the school estimates, a teadier might be reluctant to admit to 
Ws colleagues that certain topics were not covered in his courses. 

Althou^ these studies have made a valuable contribution, it appeare 
that certain changes in deagn might produce a more precise result. In two 
studies reported by Borg (1978), the investigator developed short and 
clearly limited content units to be tau^t by ^ participating teachers. TTiis 
approadi appears to have several advantages. It makes it posrible to 
develop an adiievement measure appropriate for all students in the study, 
permitting comparisons across classrooms. Furthermore, such a unit can 
deal with a topic not included in the regular school curriculum, reducing 
the likelihood that some pupfls will have had more prior training than 
others related to the content. Also, by keeping the unit short, the adiieve- 
ment measu^ can cover ^rtually evety concept in the unit. Teachers' 
recall of content covered should be much more accurate for a 1-week unit 
than for an entire year's work. Finally, a short unit permits observers to 
estimate the degree to whidi teachers adhere to the content. 

In Borg's initial study, 40 intermediate ^ade teachers tau^t a 4»day 
content unit and estimated their coverage of each achievement item. Con- 
trolling for pupil ability and socioeconomic status, a partial correlation of 
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.40 was obtamad bitween teacher covirip and pupil achliViment. In the 
second studyj 28 intennediata grade teachiK were randomly asiipiid to 
two pQups. AD tiaeheri taught two content umts with a 2-month interval 
batwetn* Ordar of teaching the two units was revereed for the two groups. 
Results dif feted for the two groups. However^ several sipuficant correla* 
tions were obtdned between teacher coverage and pupU achlevementi 
mnpng up to .67. 

It is clear that opportunity to learn is a rathir crude measure as com- 
pared with the theoretii^ formulations of Carroll, Bloomy Wiley and Har» 
nischfeger, and the Far West Laboratory researchers. Yet it is sufflcientiy 
powerful to yield significant relationships with achievinient across a wide 
range of definitions and research methodolopes* 

R^earch on Engaged Time 

Early Studies on Pupil Attention 

Another of the variables that has been incorporated into the BTES 
conceptualization of ALT Is engaged time. Engaged time is essentially 
synonymous to time on task, attintion, and participation— all of which are 
found in the research literature. 

During the two decades prior to World War Hp a number of researchers 
investipted pupfl attention and its relationship to teaching ability, 
achievement, and other variables, Jackson (1968) carried out an extensive 
re^dew of this research. He reports a study by Frendi in 1924 in which 
student behavior during rtdtation periods was observed in 26 elementary 
and junior hi^ school classrooms- French found a correlation of .82 be- 
tween a rating of teaching ability and measures of group attention during 
recitation periods. The median percentage of time students appeared to be 
paying attention was 94 for junior hi^ school classrooms and 91 for grade 
school classrooms. 

Similarly hi^i levels of attention were found in other early studies. In a 
study of two elementary school classrooms, the average attention level was 
90 percent in one classroom and 81 percent in the other (Bjamason, 
1925). In 17 eighth-^de classes, Blume (1929) found a range of attention 
from 90 to 98 percent. In a more extensive study (Edminston and 
Braddockj 1941)^ the mean percentage of attention in 200 classrooms 
varied from 80.6 to 88.2 for different kinds of activities. 

Two studies by Shaimon (1941 ^ 1942) relate attention to other school 
trilbies, "nie fi^t was carried out in two Junior hi^ schools, one of 
which employed ability grouping. 'Hiere was no dpuflcant difference in 
attention between the two schoolsp but hi^ ability poups Aowed higher 
levels of attention than lower ability poups. His second study concerned 
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the relationships between attention and achievement. Subjects were 100 
students from two seventh' and ei^th-gradi classes. Teachers read a 
lO^minute lecture^ and observers recorded pupil attention at l-minuti 
intervals. Correlations between attention aiid achievement were ,67 for 
boys and J4 for girls. 

Perhaps the most noteworthy result of these early studies ws that the 
percentage of time pupfls were observed to be attending to their school 
work was very high. 'Diese results raise a problim that investiptors work- 
ing with engaged time have never satisfactorily solved; namelyj can an 
ob^rver deterinine whether a child is attending to his or her school work? 
There are times when the child is surely attending— for examplej when s/he 
is worHng a mathematics problem or responding to a question- 'Diere are 
other times when a child is clearly not attending, such as when s^e is 
observed in some sort of disruptive behavior with other children. If* how- 
everj s/he is not actively involved in cla^room activities^ but is looldng at 
the teacheri we cannot be sure whether s/he ii attending or thinking of 
something completely unrelated to his or her school work. The work of 
Bloom (1976) and his students in which stmiulated reeaU is employed ^ves 
some evidence on this question- They made sound recordings of class sesrions 
and played them backj asking students to report the thou^ts they had 
experienced during the class session. For students in three lecture classes at 
the University of Chicago^ only 65 perceni of the thou^ts reported were 
related to the lecture. Ordy 55 percent of the thoughts reported by 
students in 29 discusaon classes were related to the discussion- TTiese 
figures are clearly much lower than the percentages of attention obtained 
in the earlier observational studies. Whethar the self-reported recall of 
students is more accurate than the appearance of attention obtained by 
observers cannot be determined. However^ the work of Bloom and his 
students certainly raises the question about the degree to which looking 
attentive actually indicates that students are attending to their school 
work. It may be that observational data for elemental school pupils are 
somewhat more valid than for college students^ who may have learned that 
looking attentive is a wise strategy in college classrooms- A study by 
Hudgins (1966) sheds some light on the relationship between observational 
data and self reports of attention. Observational measures of attention 
correlated from %52 to -.70 with self-reports of inattention. 

Engaged Time and Achievement 

During the past decadei a number of studies have explored the relation- 
ships between measures of pupil time on task and outcome measures such 
as achievement. Bloom (1974) cites studies by four of his students (Ander- 
son, 1973; Arlin, 1973; l^ademe, 1967; Ozcelik, 1973) that have been 
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concimed with the amount of time students spend in active leaming. They 
have found that measures of the amount of time the student spends di* 
rectly on learning are hi^y predictive of the achievement of the student* 
The correlationii when corrected for attenuation, account for about 60 
percent of the achievement variance. 

Bloom cites a series of his own studies in which he compared the 
performance of students in conventional learning and in mastery learning 
conditions. He found that on the first leaming taskj the on-task time of 
both groups was about equali about 65 percent of the time. The students 
in the mastery Gondition were then given extra time and help until they 
reached criterion on the first unit, while the students in the conventional 
group were given no help after they took the examination. On the final 
task, the mastery students were spending about 85 percent of their class* 
room time on task; the nonmastery students were spending only 50 per- 
cent of their time on task. Bloom believes that the mastery group was 
leaming more effective leaming techniques * while Ae conventional group 
was decreasing in their effectiveness as learners. 

Bloom (1976) carried out an extensive reww of research that explored 
the relationship between adiievement and various measures of student 
participation. He located four studies of on-task behavior in which the 
class was the unit of analysis. TTiese studies involved students ranpng from 
pade one to adults (Monhj 1956; ChaU and Feldman, 1966; Soar, 1966; 
Belgard et al., 1968). Correlations between final achievement measures and 
me^ures of participation ranged from .19 to ,51 ^ with a median of .26. 
Correlations between achievement gain and participation ranged from .06 
to .58 with a median of .29. 

Bloom reviewed nine studies in which individual students were the unit 
of analysis (Bloomy 1974; Edminston and Rhoades, 1959; Krauskopf, 
1963; Siegel et al., 1963; Attwell et al., 1967; Lahademe, 1967; Sjogren, 
1967; Turnure and Samuels, 1972; AndersoUj 1973). For the two studies 
that related final achievement to on-task behaviorp correlations ranged 
from .37 to .58, with a median of .48. For the seven studies that related 
achievement gain to on-task behavior^ correlations ranged from .26 to .87 
Mth a median of .46* 

Since Blooni's re^ew, some additional research has related on- task 
behavior to achievement. For example, an observational study of Follow 
Tiirou^ classrooms by StaUinp and Kaskowitz (1974) coded pupils as 
being engaged only when they were clearly worldng on reading or mathe- 
matics* Ihey found corfelations ranpng from .3 to .6 between enpged 
time in reading and mathematics and adiievement. 

Fredrick (1977) pthered data in 184 high school classrooms in the 
Chicago public schools. Observers gathered data on^ (1 ) proportion of 
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students presant, (2) proportion on task, (3) number arriving late or 
leaving early, (4) number of interruptions to the lesson, (5) proportion of 
classes assigned homework, and (6) proportion of students doing home- 
work when assigned. High=achieving classrooms had dgnifivantly more 
favorable scores than the low-achleving group on five of the six variables; 
that is, all except the proportion of elasses aMi^ed homework. 
Attendance was 88 percent for the high-achieving schools, nnd these 
students were on task 92 percent of the time. Comparable percentages for 
low-achieving schools were 70 and 84. This research, although not linking 
individual student behavior ^th achievement, provides data on several 
factors such as interruptions and homework that help focus our definition 
of engaged time or time spent on task. 

Another study (Good and Beckerman, 1978) linking achievement to 
engaged time was based on observations of sixth-grade pupils in two 
schools. Six observers collected 14 hours of observational data in each 
cUssroom, On^ask behawr was sli^tly hi^er for the hi^-achieving 
pupils (75 percent) than for the low-achieving pupils (67 percent). Femalss 
were on task slightly more than males (74 percent versus 70 percent). 
On-task behavior varied somewhat according to the subject matter, ranging 
from 66 percent in music to 79 percent in spelling. The investigators 
suggest that the higher involvement may have occurred in subjects like 
mathematics and spelling because these subjects are more structured and 
demand more active responses from pupils. A major factor in level of 
on'task behavior was the type of task. For tasks assigned by the teacherj 
the work involvement was 74 percent as opposed to 53 percent for tasks 
chosen by the pupfl. 

percentage of on-task behavior was highest when pupils were in small 
group activities or large group activities in which the teacher was involved. 
On-task behavior was generally less when an adult other than the teacher 
was involved. The smallest percentage of on-task behavior, 62 percent, was 
found in whole class activities led by an adult other than the teacher. 
Percentage of on-task behavior for small group activity with the teacher 
was 82; for large group activity with the teacher, 79. TTiese were the 
highest percentages reported, 

There were large differences in on-task behavior among the six class- 
rooms. On-task behavior ranged from 60 to 82 percent in different class- 
rooms, suggesting the importance of teacher behavior on pupil work 
involvement. The authors point out that althou^ the difference in per- 
centage of on-task behavior between high- and low-achieving pupils is not 
^eat, this percentage difference would, over a period of time, add up to 
substantial differences in on-task time. 
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BTES Findings on Engaged Time 

Enpgid tuna^ whiah is daflnid m the dmultanaous oacurrenee of dlo- 
cattd time and task enppment, is an important variabli in thi ALT 
mitructiohal modil» 

Ihi BTES eoUeetid a peat ded of detailid information on engagimint 
rates that is probably more accurate ^an data from most earlier studies. 
These rates vary from .70 to ,75, wWdi is in fairly dose apeement with 
other recent studies of elementao^ pupils. For example, Good and B^ker-^ 
man (1978) report rates ranpng from 66 percent to 79 percent, to con- 
trastj most early studies of pupil attention reported rates from 80 to 98 
percent, lliese differences co^d be due to different operation^ deflni^ 
tions of on-task behavior. Another possibility that must be conddered ^ 
that the greater proportion of teacher-centered direct instruction found in 
classrooms 30 years ago co^d have residted in higher rates of on-task 
beha^on "nus pOMibility is discussed by RoseniMne and Berliner (1978), 

A major conclusion from the BTES is that the rnnount of time that 
students are engaged in relevant rmding and mathematics tasks is posi^ 
tively associated with acMemic achievement. 

Analyses of the relationdiip between Academic Laaming Time variables 
wd student achievement were conducted separately on the October- 
December (A-B) md the Jmuaiy-Aprfl ^C) data to provide replications 
of the analyses. In practice^ however, the A-B analyses were primarily 
exploratory; the frC analyses were more conflrmatory. Since the B-C 
analyses are based on a much larger data set and were focused and im- 
proved based on the experience with the A^B analyses, the results can be 
accepted with somewhat more confidence. However, the A-B residts cer^ 
tainly deserve serious attentioni dnce the A-B data set is doubtless the best 
research e^dence avalable on engaged time prior to the B-C phase of the 
study« Of cour^, relationslups that emerge from both sets of analyses are 
those that desem the peatest attention, elaboration, and possible 
appUcation« 

A-B Analyses. Table 2,3 presents the resists of the regression an^yses 
on the effects of enpged time in reading and matiiematics on achievement 
during the A-B periods Results are given for subtopics under reading and 
ma^ematics as weU as for tot^ reading mA total mathematics, ^^e pro- 
portion of total postadiievement variance accounted for by preachleve- 
ment is pven. 

The resuhs in toble 2,3 indicate that engaged time positively elated 
to student learning In three of ihe four reading content areasj induding 
total reading at pade two* No li^flcant results emerged in grade fivi 
rea^g. 



Tibia 2X R^^ions Analyzlni Ag EtUcU of Enpged Time' 
Analyias of Reading and Maftematics Achievemint at Gmdis 2 and 5 During the A-B Period, Regressing 
Poit^hievenient on Preadiievenient and Eng^ed Tbna 



Content cita|ory 
for poitachieyementp 
pmohlmmenti and 
enpged time 



of variance 
i€^unt@d 
for by pr©' 
achiivement 



Engaged time^ efYecti 



Signifleancg 
"P<.01 



Grades (N= 127) 



Total compreheniion 


.31 


• 


Total decoding 


M 




Total word structura 


.40 


« 


Total rtading 


.71 


* 


Addition and subtrgotion; 






no regrouping 


,41 




Addition and subtraetion: 






sp^dad t§sta 


.49 




Computationil tranifer 


.28 




Pla^ valu§ and numerali 


.38 




Word problems 


.29 




Money 


,43 




Total mathematies 


43 





Sign 
+ positive 
- negativg 



+ 

+ 



Proportion 
of 
residual 
wianeeb 



.08 

.04 
.05 



70 



Grade 5 (N^ 122) 



Totgl word memlng 


.58 




Totil eomptthtniion 


.71 




Word structure: lyUablis 


.41 




Total reading 


M 




Total geomttry 


.24 




Total multlplloation 


.28 




Multiplication speeded tests, 
basie facts tiine 


.54 




Division 


.24 




Fraetioni 


.08 


«* 


CQmputationil tranifer 


.55 




Word problems 


.22 




Total mathematics 


.70 





+ .13 
+ .14 

-.03 

-I- ,06 



iComputed by taking the produot of alloeat^ time In the intent category Cbaied on teacRer logs) and 
enpgement rate (based on observation), 

briiis U the proportion of the reddud variance accounted for by engaged time^ where residual vanance 
refers to the variant remaining in tte pestachievement measure after preaehlevfc nent is removed. 

Source: From Fisher et aL (1978^ pp, 4-17), 
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In the seven grade two mathematics arias there were no simlflcant 
relation^ps with residual achlevemint, but results were sipiflcant for 
tive^of the eight areas In grade five mathematics. Proportions of simiflcant 
residual variance ranged from .04 upward, with four of the eight signifi- 
cant vanances ranffng from .08 to .20. The largest effect was for fractions 
at grade five, where 20 percent of the residual variance was accounted for 
by engaged time. M but one of the significant engaged time effects were 
positive, and the one negative effect (multiplication speed' tests at grade 
flve) was the smallest of the sipiificant effects. 

B^C Analyses. The results of analyses of engaged time in reading and 
na hem^atics at grades two and five during the B-C period can be found in 
fawe 2.4. Some changes were made by the investigators in the set of test 
scales admrnistered at grade two for the BC period as compared with 
those for the A-B period. These changes were made to reflect chanps in 
instructional emphasis from one period to the next. 

pie B-C analyses of engaged time confirmed the positive effects found 
with the A-B data but were more consistent in that positive effects were 
found m aU four quadrants (reading and mathematics at grades two and 
flve). No simlflcant negative effects were found for engaged time in the 
B^C period. Where the neptlve A-B result had occurred (multiplication 
^eed tests), a significant positive effect was found In the B-C analyses 
The strongest effect was for fractions at grade five, where 26 percent of 
the residual postachievement variance was accounted for by engaged time 
The second set of B-C regressions analyzed allocated time and eneaae- 
ment rate as two separate variables. It had been found In the A-B analyses 
that separatmg engaged time and low error rate was more effective than 
combming them in terms of predicting student learning. Therefore it was 
decided to determine the effect of separating allocated time and enoaae- 
ment rate. * 

Table 2.2. which we discussed in part with regard to allocated time 
effects, presents the results of analyses of allocated time and enpgeme U 
rate m readmg and mathematics during the BC period. Consistent, positive 
results were obtained for both allocated time and engagement rate When 
riiese are analyzed as two separate variables, they are more highly pre- 
dictive of student learning than is their product, engaged time. The two 
separate variables taken Jointly often account for more variance than their 
single product, and they never account for less. They jointly account for 
an average of 4.9 percent of the residual variance, whUe their single 
product accounts for an average of 3.1 percent. Therefore, allocated time 
and engagement rate are more strongly related to student learning when 
andyzed as two separate variables, and they were so entered in subsequent 
analyses. ^ 
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Summary 

Rgseargh iAddence accumiilatid over the past 36 yeare shows coniistint 
poative ralatlonAips between timi on task and achievement, When we 
find 16 studiis that differ in virtually every aspect of desipi and yet yield 
Gonsistent poritive results, we can be very confident that the relationships 
found are real and enduring, ^though sonii correlations between achieve- 
ment measures and on-taik time are as as .87* the majority are in the 
mngi from JO to ,50^ thus acaounfing for 9 to 25 percent of the adiieve- 
ment varianci* Virtu^y ^ the sipuflcant relationdiips found in the two 
phases of the BTES dso fall into this range. These resists clearly demon- 
strate that schooling does make a difference. 

^e evidence oh engaged time shoiid not come as a surprise since it is 
clear that one cannot learn ^thout devoting time to learning* However, 
one needs only to ^it a few classrooms to see that tremendous amounts 
of time in most are not being devoted to relevant learning tasks* IWs 
observation is supported by research evidence on wait timej transition 
time, and similar variables. 'Hierefore, ^though tile importance of enppd 
time is self-eiddent, it is equdly evident that many teachers are unable to 
increase this important factor and in many cases are themselves guilty of 
wasting a great deal of time that diould be devoted to learning. We already 
have some knowledge of factor that can lead to increases in engaged time 
in the classroom. The BTES findings contribute substanti^y to that 
knowledge. We must now develop effective propams to g|ve teachers both 
preservice and inservice training in skills and strate^es that ^1 increase 
the time students devote to relevwt academic learning. 

Resaarch on Academic Laamlng Time 

We have reviewed previous research and the BTES resuhs relating dlo- 
cated time and enpged time to ^hlevement. Althou^ there has been no 
previous work on academic learning time as deflned in the BTESj much of 
the earlier work leads up to the ALT CDncept and includes iome of the 
same variables. Carroll (1963), Wfley and Hamischfeger (1974), and Bloom 
(1976) all include some estimate of quality of instraction in their models, 
a variable that also flgurei prominently in the BTES modeL AH three 
modeb abo indude a variable simQar to task engapment. This variable is 
inco^orated as well in Cohen's (1969, 1971) work in reading and in 
recent major research projectr such as the Follow TTirough studies by 
StaUingi and Kaskowitz (1974), 

We vrfU now examine the most sophisticated of the BTES time vari- 
ables. Academic Learning Time, and review the relationdiip between this 
variable and pupfl achievement. ALT is defined operation^y in the BTES 
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TaWa 2 A R^^lons Analyzing As Effects of Enpged Time- 
Analyse of Riding and Maftimaties Adiievament at Gradts 2 md S Durini tfie frC Period, Regressin] 
Postachtevement on Pre^iavenient and Engaged Time 



Content oategory 
for postgdiievement, 
preachleveminti and 
inppd time 


Proportion 
of varianee 
amunted 
for by pre- 
ichievement 


Signiflcance 
**P<.01 


Engaged tlme^ ifTects 

Sign 
+ positive 
^ negative 


Proportion 
of 
residual 
variince^ 




Qr3de2(N=l39} 






Total comprahensiDn 


M 








Decoding blends and 










long vowels 


.49 




+ 


.03 


Decoding vafknt con^nants 


.12 








Dceoding compleH patterns^ 










spelling dine 


Al 






.05 


Word structure: 










meaningful units 


.49 








Word structure: syllables 


.09 


*• 




.07 


Total reading 


,68 






.02 


Addition and subtraction: 










no regrouping 


,24 








Addition and subtraction: 










speeded test 


.35. 


« 


+ 


.03 


Addition and subtraction: 










with regrouping 


.06 




+ 


.03 


Computiitional transfer 


,32 




^ A 





Pliea value and numersls .47 

Word problems ^27 « + -W 

Money M 

Lm%$x measurement ^ 1 9 

Fractions OS ♦* + -iO 

Total mathematics 'SB 

Grades (N^ 122) 

Total word meaning '69 

Total comprehension .66 *• + 'l^ 

Word structure^ syUables *3I 

Total reading .77 »♦ + 

Total geometry il2 

Total multiplication 43 
Multipltation ^eed test, 

biSlo facts time .65 + -O^ 

Division .30 

Fractioiis 28 + 

Computational transfer .58 

Word problems .38 

Total mathematics *69 * * 



.03 



^Computed by taking the product of allocated time in the content category (based on teacher logs) and 
engagement rate (based on observation). 

^^TTils is the proportion of the residual variance accounted for by engaged timeg where residual variance 
refers to the variance remainii^ in the postachievement measure after preachievement is "removed*" 

S^rce: From final f eport* pp* 4-24. 
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tody^s as tfie rfmultanious occumncg of lUoeated timi, inpgemint 
rati, and suecess rati. In othir words, ALT k the timi a pupfl is 
tnppd in the study of relfvwt content that s/h§ can liam making no 
more thim ehanca arro^. Smca content that generates low suceeis rate is 
h^^othirized In the ALT model to lead to lower a^eve ment, this variable 
WEB dso included in the regresdon ^alyses. 

Om of the rnajor condiisioni emerging from the FTIS analysis was 
that AmdemiQ Leamtng TMe is positively related to student achievemenL 
Let m now reilew the e^denee that supports this condusion. 



A^B Ancdyses 

Th$ analyses of ALT and learning consisted of a series of regressions 
that examined the joint effect of dl four ALT variables together for both 
the A*B and the frC period data sets. TOe results for the A-B period are 
premted in table 2 J, and those for the B< ^riod are in table 2,6. As has 
b^n the case for the preceding tables, wlwn a variable showed a sipiflcant 
effect (p<,l OX the unique proportion of reddual variance accoimted for 
is reported. In addition, the sipi of aU effeets, reprdless of significance, is 
repoited. The joint contribution of ^ four ALT variables is reported for 
each content ^tego^, wwm when no variable diows a unique individud 
effect that is dgnlflcant. An exanination of table 2,5 shows that in 
general, located time, enppment rate, and low error rate are eadi posi- 
tivdv associated with aohievOTent, while hi^ error rate is negatively re- 
lated to achievenient^ 

However, in this section we are concerned primarfly with the combined 
effect of ALT, so wfll not exMnine in depth the indi^dual influences of 
the four ALT variables. For pade two, the residual variance accoimted for 
by tlie combined ALT variables range from ,02 to ,12* For the four 
indi^dual ALT vmsbles, there ware 7 of 16 signiflcant residual variances 
in reading and S of jS in mathematics. 

For grade five, the residud \^riahce for the combinid ALT variables 
ranged from .02 to .23, There were 4 of 16 sipificant reridud variances 
for the individual ALT variables for grade five raading and 13 of 32 for 
matiieniatics. Iliere were apiflcant residud variances for aU four ALT 
variables and for the combination of these i^riables in Ml four quadrants. 
Of the dpaficant effects (p < ,10), there was only one exception to the 
generalization that effects for aUoeated time, engagement, and low error 
rate were positive, while those for high mot rate were ne|ative. TWs 
exception was the neptive effect for allocated time in addrrion md sub- 
traction speed tests at grade two during the A-B period. 
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B'C Analyses 

Table 2,6 show that Uie B-C results are somewhat stronger and mbre 
consistent than the A^B results. Hie one si^floant result in the A^B 
andyds that was contrary to the ALT modeU (allocated time, grade two, 
addition and subtraction speed tests) was positive in the B-C analysis* For 
second-grade readings the residual variance for the combined ALT variables 
ranged frorn *03 to Jl and averaged .12, as compared mth ,07 for the A-B 
period. Twelve of the 28 residual variances for the four individual ALT 
variables were signiflcant* For grade two mathematics, the combined ALT 
variances ranged from *01 to ,22, ^th an average of ,08, double the ,04 
averap for the A-B analysis. For the indivddutd ALT variables, 11 of 40 
residual variances were signiflcant. 

For grade five reading, the residual variances for combined ALT ranged 
from ,05 to *21, with a mean of ,13, as compared with a mean of .03 for 
the A'B analysis. Combined residual variances for mathematics ranged 
from ,01 to ,30, with a mean of .1 1, as compared with ,09 for the A-B 
period. 

OveraD, there were 41 signiflcant residual variances, or 35 percent, for 
the B-C analysis and 3 1 (omitting the one negative resuit)i or 34 percent, 
for the A-B analyses. 

Hie specific reading and mathematics content areas were not identical 
for the A-B and B»C periods because of changes in curriculum, mostly in 
pade two reading. Hie grade five content areas were identical for the two 
periods j and only three new areas wei^ added to grade two mathematics 
for the B-C period, "nius, many direct comparisons are possible between 
regressions for specific content areas and ALT variables between the two 
periods. 

Table 2.7 summarizes the specific agreements and disagreements be^ 
tween the two periods. Of the 84 direct comparisons possible (Le., same 
ALT variables— same pade, and same subject area) 47 residual variances 
were si^ficant in one or both periods. Of these 47^ 1 1 were significant in 
both periods, Wien we consider that the probability that a result at the 
,10 level vM occur in two consecutive replications is only .01 * these results 
are impressive. 



Conclusion 

In tracing the previous research on aUocated time and engaged time, we 
find consistent relationships with pupfl achievement that increase as re- 
search focuses more sharply on the actual time the individual pupil devotes 




A I ^ 5- ''1* Combined 

Analyses of Reading and Mathematics Achievement in Grades 2 and 5 for the A B P^n'nH B „ • 



Content Qategory 
for postaehiavement, 
preachl§vemen!, and 
iilocatad time 



Pfoportion 
of varianei 
accountad 
for by prt' 
ichiavtmant 



^ __Unique pfoportion of raiidual variangga 

+ pQSitiva effact *p<.10^ 

^^p<.'qi 



^ negativa affect 



AUocatad 
timeb 



Engagamant 
rataC 



Grade s (N^ 127) 



Total comprahansion 


*31 


+ 


,03 + 


Total dacoding 


.65 




+ 


Total word structure 


,40 


+ 


.02* 


Total ragdlng 


.71 


+ 


+ 


Addition and subtractioni 








no ragrouping 


.41 


+ 


+ 


Addition and subtraction: 








spaadid tests 


.49 






Computational transfar 


.28 




.03* 


Place value and numerals 


.38 


+ 




Word problems 


.29 






Money 


.43 


+ 


+ 


Total matheniatics 


.63 


+ 


+ 



.02 



78 



Low 
errorC 



+ 
+ 

+ 
+ 
+ 



.08 
.01 

.03' 
« 

.02 
.03 



.02 



High 
arrofc 



+ 

+ 
+ 



.02" 



+ 

+ 



RasiduaJ 
variance, 
combined 

ALT 
variablasd 



.09 

,02 

.12 

.03 

.04 

.05 
.11 
.02 
.02 
.02 
.04 



3" 

Q 

3 
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GmdMS(N^i22) 



Total word miaRing 


M 






+ 




+ 


.02 




.03 


Totil coflnprehinsion 


ni 






+ 


• 

,01 




.03 


+ 


,06 


Word ftniGture: syUables 


Al 










+ 






,02 


ToUl reidiflg 


.81 






+ 






.02 




.15 


Total geometry 


.24 


+ 


Al 








« 

.02 




.15 


Total mtiitipUcatioQ 


.28 


+ 


.05 


+ 






.03 


•* 

.03 


.16 


Multiplication ipeaded tests: 








+ 












basio faets time 


J4 
















.02 


Dlvislotl 


,24 


+ 


.02* 


+ 


* 

m 








.05 


Fiactions 


.08 


+ 


.22** 


+ 


.02* 








.23 


Computationai transfer 


,51 






+ 








« * 
.01 


.04 


Word problems 


.22 


+ 




+ 




+ 


* 

.03 


* 

,02 


.07 


Total mathematics 


.70 






+ 




+ 




•* 

.02 


.02 



^This ii the proportion of the residual variance agcounted for uniquely by the Indapendenl variable specifled, where residual vari* 
ance re maining in Ae pQitachievement measure after preaghlevement is "removed.'* 
bfiaied on t^oher logs. 
^Based on obieryation. 

^This is the residual variance aecounted for by alloeated times engiiemant ratap low error rate, and hi^ arror rate* ineluding vari- ^ 
ance "shared" among these four variables. & 
Sour^: From Fisher et al. (1978^ pp.4-30). S 
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Table 2,6* Rapesslons Analyzing the Combined Effects of ALT Variables: 
Analyses of Reading and Mathematks Achievement in Gmdes 2 and 5 for the B-C Period, Regreising 
Postachievement on Pmaehieveinentt Allocated Time, Enpgement Rate, Low Error Rate, and Hi^ Error Rate 



Content category 
for postichievementi 
preachievement^ and 
iUoGitad time 



Propoftion 
of variance 
accounted 
for by pr^ 
achievament 



Total comprehension .32 

Dacoduig blends and 

long voweis ,49 

Decoding viriant consonants 42 

Decoding complex pitterns: 

ipelling time .47 

Word structure? 

meaningful units .49 
Word stnJCture: syilables ,09 
Total reading .68 
Add and subtract: 

no regrouping ,24 
Add and subtract: 

ipieded test »3S 
Add and subtract: 

with regrouping .0$ 
Computational transfar ,32 



Unique proportion of fgiidjial yarlance^ 

+ positive effect * p < . 1 0 

- negative effect **p^,01 



Ailocated 
timeb 



Engigement 
rate^ 



Grade 2 (N^ 139} 



.03 



.02 



.06 



" .03 

+ * 

■ .03 



" .04 
+ 

+ 
+ 



* 80 



Low 
error^ 



" .02 

+ ^ ** 
.08 



* AO 



.04 
_ * 
.03 



.03 



4. ** 
.14 



+ 



.OS 



High 
error^ 



.03 



.02 



+ 



Residual 
variance, 

combined 
ALT 

variablasd 



.03 

.17 
.13 

.21 

.03 
.14 

•,11 

.04 

.22 

.06 
.06 
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Place valui and nuRief ids ,47 * ' ^ * .01 



Wordproblcmi .27 .02 ^ * * ,02 .07 

Money .34 ' * * .02* " .03* .12 

Linear meapirtmetit .19 ® * * " ,04 

+ ** * + + 

FmUotii .05 .10 AX 

Total mathemitics ,58 * .03 " .06 

Grades (N^ 122) 

Totil word mining .69 43 .15 

Total compfehendon .66 44 .06 »21 

Word structufe: ^Uablts ,35 " * ' " .04* .OS 

Totil readiiig .77. * " " ,03* 41 

Total iiometry .12 * * ,03* " " ,03* .07 

Total multlpUGation .33 "** " * ,06** ,11 

Multiplication: spe^ test; a • * + * 

baiig fact! time .65 .02 * .03 ,03 ,13 



Division ,30 * " ' .06 .09 

FrigUoni .28 ,17** * " " ,04** ,30 

Computational transfer .58 .03 .05 ,10 

Wordproblcmi ,38 " ^ " .01 



_ m 



Total mathematbs S9 .05 .02 .03 



+ + - nn* ftl S 



^This is the proportion of the reddual varunoe icoounted for uniquely by the independent variable ^eoifled, where residud vari> 
^ee refer! to the vgriinee remaining in the postaehiev^ent meagre after preaehievement Is "removed" 
^BaMd on teaehei logs, 
^ased on obieivation. 

^Ilik is the reiidyd VMianoe aceounted for by aUoaated time, engi^ement ratei low error rttep and hi^ error rate, including 
varianQe "sh^ed' * imong tiiese four wtablei. 
Soum: From Fish^ et iL (1978, pp. 4-31). 
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Table 2 J. Compari^n of the Two Periods 





Numbar 

of 
AB^BC 
eompariiani 


Residuals 
siinifl^nt 
in 

AB only 


Rtsiduals 
signin^nt 
in 

BConly 


Residuili 
signiflGant 
in both 
r pariods 


Gnde 2 retding 


8 


3 


1 


1 


Gmde 2 snathamati^ 


28 


3 


4 


5 


Grade S raadlng 


16 


3 


4 


1 


Gridf 5 mithematiss 


32 , 


9 


9 


4 



to relavant academic work. ITii BTES flndingSj dthou^ derived from a 
much stronger and more sophiiticated data baie, are substantially in agree^ 
ment with earlier research* 

The ALT model is a ^eat leap beyond the pre\doui researdi on engaged 
time since it incorporates into the BTES analysis variables such as an 
instructional strategy and difficulty leveL The theoretical work of Carroll, 
Bloom, and Wfley and Hamischfeger also conriders such variables; and it is 
clear that their tUnWng has had an important influence on the ALT model 
of school learning. TTUs model, however, appeai^ to be a clear advance over 
the earlier formulations, and appeara to fom a useful basis for maWng 
future decisions reprding time allocations and for shaping future policies 
in areas such as teacher education and certiflcation. 

Although some cadence has been assembled that supports the earlier 
models of school learning, there is much more e\ddence supporting the 
ALT model that has emerged from the BTES, 
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Thi Academic Learning Tima framework of cl^sroom initruetiorij wi A 
its specification of instruction^ functions * as developed in the Be^nning 
Teaehar Evaluation Study, has considerable hiuriitic value in posing new 
re^arch questions and in forming important policy issues in education. 
The relationship of the framework to initructional research and insUtu- 
tional characteristics of schools merits the attention of both researchers 
and educators. Its implications for policy at all levels of the educational 
sphere deserve tiie serious consideration of persons whose decisions are 
aimed at improving schooling. 

*nie BTES concept of schooling f^uses on the amount of instructional 
time to which students are exposed in school and the amount of time Aey 
actudly spend leaming. Exposure to learning is related to both instruc- 
tional planning actions and instruction^ interaction beha^ors of teachers. 

TTie Academie Leafning Time Framawork 

Hie underlying principle of the framework is that pupils' activities are 
central to their learning. Leammg is a process that takes place in time. A 
stud^t learns a given subject to the extent that s/he has the opportunity 
to learn and that s^e spends time actively enpged in learning; that is, 
paying attention, studying, ttying to learn. 



DescHption of the ALT Framework 

Acadan^fc learning time (ALT) Is the tem used by the OTES staff to 
describe student learning. Teacher behaviors are considered to be a part of 
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the instruGtional process/environment tiament of the modeL It is impor- 
tant in this frarnawork that teEcher bihaviors are directly related to the 
enpgad learning tune of students. Pupil enpged time, in this model, is the 
immediate dependent variable for studies of teacher behavior. TTie basic 
proposition of the BTES framework is: What teachers do, directly influ- 
ences the time a child is actively engaged in lemiing. This relationship is so 
simple and so obvious that it sounds naive, but somehow it has escapad 
extensive study. 

"Student learning time" as an interim variable between teacher be- 
haviors and pupil achievament has been considered before.^ However, 
*'student time" has been used only as an independent variable to predict 
some student performance variable such as an achievement test score. ^ 
Tlie practicd importance of shifting enpged time from its role as one of 
many predictor variables of achievament to being the primary dependent 
variable for classroom studies cannot be underestimated. 

The teaching behaviors that influence student classroom learning were 
thou^t by the BTES staff to be six Interrelated functions (diaposis, 
prescription, presentation, student activity, monitoring, and feedback) 
that occur throu^ time In a rou^y cycUcal fashion. 

In essence the basic BTES Academic Learning Time framework Is a 
process-product teacher effects model as described by Doyle (1977). ITie 
instructional processes within the BTES framework have been formulated 
in terms of a diapiostlc-prescriptive franiework where the product is 
student enpged time rather than student achievement. 

The potential practical importance of identifying causally related func- 
tions for teacher instruction^ planning and instructional interaction must 
be pointed out. In the pastj long lists of teacher behaviors have been 
examined and related to student perfomiance. Replacing long lists by a 
mall set of generic teaching functions should help in reorienting research 
toward explanatory theories of teaching. 

The BTES staff defined the variables^ of the Academic Learning Time 
framework as follows' Firstj as an index of student classroom learning the 
teacher's allocated time for reading and mathematlci instruction on rele- 
vant tasks was used as a starting point. Task relevance was included to 
improve the prediction of achievement. Only those tasks measured by the 
achievement tests were conildered relevant* Next, they eitimated the 



*For an overview of studies udng "time" es a variable see Karweit (1976). 

2This rektionihip of enppd time to achievemint was also studied in BTES (see 
Fisher et il., 1978). Also see **Time and School Learning" by Borg in the present 
volume for an analysis of that relationship. 

^Each of the variables is operationiUy defined in terms of coded observed 
behaviors. Thus^ the labels f jfer to codes r&[h^r than logiral categor fes. 
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number of minutes (of the allocated time) itudents were engaged in learn- 
ing (as opposed to time spent waiting, or in transition between tasks, or 
off task, or engaged on nonrelevant tasks). ITiis time scale was further 
refined by adjusting engaged time for student suecea rate. 

Success rate, as used in ALT, is a complex concept that warrants elabo- 
ration* It is intended to reflect the depee to which the student under* 
stajids the learning task correctly. If the task is very difficult and the 
student produces few correct responses during the task, the activity wiU 
not produce much learning. On ^e other hand, if the student produces 
many correct responses on the task^ it is hypothesized that learning is 
occurring. 

Success rate was assessed in BTES in three fairly broad categories. Hi^ 
succ^ rate described situations where the student had a good grasp of the 
task and made errors at about the chance level (-^careless" errors). If a 
student did not understand the task and made correct responses at about 
chance level, the situation was labeled low success rate. Situations that faU 
between low and high success rate were defmed as medium succe^ rate. 
Medium success rate involves partial knowledge, where the student under* 
stands enough to produce some correct responses but also commits errors. 
ALT includes only enpged time spent on hi^ success rate tasks. Task 
relevance was included to hnprove the prediction of achievement. Only 
those tadcs measured by the aoWevement tests were considered relevant. 

In summary. Academic Laaming Time (ALT) is time spent by a student 
enpged on a task in which few errors are produced^ and where the task is 
directly relevant to an academic outcome. Tlie steps used to define ALT 
are shown in figure 3. L 

To complement ALT, a second pupil activity variable also was iden» 
tifled; namely, that portion of relevant, enpged time spent on tasks with a 
low success rate. 

Secondj to define the instructional process variables, the teaching be- 
haviors included in the BTES were first grouped according to three func» 
tions of interactive teaching behavior: presentation, monitoring, and feed- 
back. Three types of presenmtian were included— explanation-planned, 
explanation-need^ and structure/direct. For planned explanation, the 
teacher provides substandve academic information to the student. This 
type of presentation is similar to a lecture. For explanation based on need, 
the teadier provides substantive information specifically in response to 
perceived needs or mjsunderstandinp of the student. Structure/direct in- 
volves presentetion of procedural information. 

Two types of monitoring were includid— academic observation and 
a^d^rtic queitionin|. Monitoring was defined as behavior which provides 



Tims To Leam 

F^ure 3.1 Definition of ALT 




Allotted Time (AT) as t subset of Enpied Time ^T) il a sublet of 

Relavant Insttugtionil Time (IT) AUoeated Time (AT) 




Enpgad Time sapusted into hi^ (H), 
noddle (M)i and low (L) lus^is rates. 
A^demie Leirning Tiine (ALT) as 
Enpged Time vdth high suo^si rite 



infomiation for teacher about how well a studint performs a partieular 
task* For academic observation, some i^dence of performanci is ovartly 
present, and tiie teacher examines the evidence. For academic questioning, 
the teacher asto a question to elicit an obsenrable response. 

Two types of feedback were included-academic feedback and task 
engagement feedback. Feedback lets students know how they are doing; it 
helps evaluate self-performMice, For academic feedback, tiie student Tnay 
receive infomiation about his or her acadOTic performance or may leam 
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whether the answer is ri^t or wrong, or what the right answer is. In task 
engagement feedback, the student ii told whether the behavior is accept- 
able or unacceptable, or what %fhm should be doing. 

Defining the variable involved in plannlng=categorized in the frame-' 
work under the labels diaposis and prescription-proved to be more diffi- 
cult. Tlie total number of measures actually obtained was larger than the 
number of classes in the study, a mind^bog^ng task for quantitative analy- 
sis. Hie BTES staff anticipated that many measures would prove un- 
reliable, and they desired multiple opportunltias to measure important 
variables. Nevertheless, it was a major undertaking to reduce the size of the 
variable pool in a manner that was satisfying to both the logic of the 
measures and the empirical evidence of interrelationdiips. 

Diapioris refers to the teacher's ability to recopJze the strengths and 
weaknesses of individual students. Three variables were selected to repre- 
sent the domain of diaposis. The first, item predieUon,is a direct measure 
of the teacher*s ability to predict how each target student will perform on 
a representative set of items from the achievement battery. TTie second 
diagnosis vaiiable Is knowledge of subject matter. It was derived from the 
teacher's performance on a content coding test, and it reflects the 
teacher's grasp of the concepts and tenninolo^ of reading and mathe- 
matics pedagogy. Such knowledge presumably provides a framework for 
diagnoas. The third diagnosis variable is an interview-based rating of differ- 
endated perceptions. 'Die rating reflects the degree to which the teacher is 
aware of and comments on individuai characteristics and needs of different 
target students. It is not necessarily cognitive in fDcus and says nothing 
about the accuracy of the teacher's differentiations, Presumabiy, like 
knowledgo of subject matter, perception of individual students provides a 
precondition for diagnosis. 

Finally, the pre^ription function was die most complex to assess. It 
refers to the teacher's decisions about what to do in the classroom. A way 
of looking at prescription chosen by the BTES staff was to examine how 
instruction^ decisions were made. ITiree variables were selected to de- 
scribe specific aspects of tiie way prescription decisions are made. 

The first prescription variable is a rating of goal orientation. It com- 
bines goal-directedness-^a rating of the extent to which the instructional 
program identifles specific goals for learning activities--and content goal 
assessment-a rating of die extent to which the program includes both 
testing to see if goals are reached, and sp^ification of the next instruc- 
tiond steps to be taken, depending on whether goals are reached. TTiese 
two mtinp were combined to indicate the extent to which the program Is 
goal oriented. In a hifidy goal-oriented program, decisions are based on an 
orderiy propession towrd clearly stated gods. 
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The second prescription variable is propam change based on need. On 
each day of observation^ the tiacher was asked if any changes had 
occurred in the target students or their propam. One type of response the 
teacher made was to report a change in a student's pro-am because of 
something that had been observed about the student's perforniance. For 
instance, the teacher might have noticed a student having trouble with 
some concept and assiped special homework. TTie score used for these 
andyses was the average of number of program<hange-need state- 
ments made throu^out the year for observed students. Tliis variable pro- 
vided a relatively objective measure of the extent to which teachers decide 
to make changes based on ongomg observation of student performance. 

The third prescription variable is a rating of flexible use of curriculum 
materials. It differentiates between teachers who strictly follow the proce- 
dures and sequences contained in curriculum materials and teachers who 
continually modify materials and procedures based on student responses. 
It reflects ^e extent to which decisions are made by choosing a cur- 
riculum and following its mandates, as opposed to using a more complex, 
ongoing, adaptive decision framework. 

In summary, to study the relationship of the five types of teacher 
behaviors (diagnosis, prescription, presentation, monitoring, and feedback) 
to student activity, the BTES operationally deflned 14 variables. The over- 
all framework is shown in figure 3,2.^ 

The instrumantation and analysis techniques need some discussion. Al- 
thou^ this is not the place to discuss in detail the technical details of how 
data collection instruments were developed and used, how the data were 
scaled, and how analyses were carried out, the researcher interested in the 
conceptual ideas of this ALT model would be well advised to read care- 
fully the voluminous documentation of these procedures provided by the 
BTES staff. A few comments, however, are in order. First, the primary 
procedure for gathering data on ALT a_nd the presentation, monitoring, 
and feedback variables was direct observation. ITie actions of a sample of 
students in each classroom and the related teacher actions were coded. 
Observations were pthered on several occasions over a year of instruction. 
Second, data on allocated time and on the diagnosis and prescription 
variables were collected from a variety of traditional sources=teacher lop. 



^In addition to ihcm 14 variables other leneral information about clasirooms was 
coUacted. This information was later organized into five ieneral variables (Appro- 
priatene^ of laitruction to Student Needs. Global Ratini: Like Class?, Perceived 
Academic Com^tence* Orientation Toward Affect, and Learning Environment). For 
the BTES study the^ variables were not conceived as measuros of the five types of 
teachef behaviofs. 



88 78 



Thomas A, Romberi 



Fi^re 3.2 Thi IS ^aratioDaUz^ Variables Used in the BTES Schematic 
of Iiiiteuctsonai Functions in the ALT Framewo A 



InstruQtlonal 
planning 

A 



Instructional 
interiction 



Ditgnosis 



Ittm prediction 

Knowledp of 
lUbJeQt mattgr 

Differgntiitgd 
parceptions 



r 



Piescription 



Presentation 



Goal orientation 

Ff ogram chanf § 
based on need 
Flexibility of use 
of curriculum 
matirials 



Expianation 
planned 

• Explanation 
need 

• Structure/ 
direct 
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teacher intirviews^ questionnaires, and general obiervatlons. In SL /eral 
c^Sj raw data from these sourcei were combined and statistically trani- 
formid to create scales for later analysis. TOus, for siveral variables^ the 
label given to a scale refers to a score derived from several sources. Third, 
much of the andyds, although careftjUy and exhaustively documented, 
must be called exploratory. Means, correlations, transformations, a variety 
of reliabflity indexes, and other statistics are presented and discussed. 
Finally, althou^ Ae relationship between variables in the teacher behavior- 
student activity portion of the ALT model is explicit, the analytic proce- 
dures adopted were not intended to test tfie model Tlie methodolo^cal 
technique used was multiple repesdon analysis with ALT or student 
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achievement as the dependent variable and the diagnosis^ prescription, 
pfesentation, monitoring, feedback, and several other variables used as 
predictors- The other variables included a potpourri of environmental and 
general variables considered to be important but not explicitly part of the 
teacher behavior-student activity portion of the ALT modeh^ Although 
pfocedures more appropriate for testing this model could have been used, 
the analysis plan was consistent with the exploratory nature of the study. 



Properties and Assumptions of the ALT Model 

Several properties and assumptions of the BTES ALT niodel deserve 
attention. It is a model in the true, but exploratory , sense of the term; that 
is, it represents a conceptual scheme that identifies a set of teacher be- 
haviors relative to student activities and posits relationdiips among them. 
It is not a theory because it does not explain the causal mechanism under- 
lying the relationships. Nor does it state the precise nature of these rela- 
tionships by specifying, for exmple, a functional form to deflne the way 
in which the variables interact. Instead, it describes the process of student 
learning by presenting a small number of independent concepts about 
planning and interaction, and it hypothesizes causal relationships among 
them. However, since the causal relationships are considared to be sug- 
gestive, the causd structure is not examined.^ 

Second, the model applies to the instructional activities of students and 
is not intended to explain the socialization or social development of chil- 
dren wi^in the school context. Teacher efforts to influence students' 
attitudes, norms, values, and social behavior are not defined as learning 
tasks and, consequently, are ignored^ SimUarly, peer influences on pupils' 
motivation and effort are omitted. To the extent that variables which 



5 See foomote 3, 

fiThe conceptual power of identifying generiG teachini functions is in its potential 
for theory bufidini. That ii, cauial reUtionshipi are predicted for functions hy- 
pothedzed to be episodic. Variability on **diaeioiis'' causei variabUlty on "prescrip- 
tion"* variability on "pte^ription" causes variabflity on "presentation," and so on. 
The arrows in fiiures 3,1 and 34 indicate tha hypothesized directions of causality, 
Thase hypotherized causalities, howevef » were not tested in the BTES analysis. Tech- 
niques for doing luch an analysis using stmetumi equations are available. The de- 
ciMon not to carry out such an analysis was a deliberate one by the BTES staff. It was 
based on the exploratory nature of the study, the need to do potentially complex 
data agpeiationi for the sets of variables associated with each instructional function, 
and the lack of adequate resources* 
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influence attitudes and motivation have an impact on engaged time, the 
omisdon of these .ictors is a limitation of the model J 

The appropriate area of application of the model is the traditional 
classroom. The model assigns a central role to the teacher. All institutional 
effects on pupil enppment are mediated through the teacher. Teacher 
activities to detennine learning are the primary influence on pupil pursuits. 
The model implies a classroom in which the teacher is the main authority 
figure and has considerable control over students* activities and time. The 
extent to which other orpnizational arrangements require other teaching 
functions in this model is limited. Some of these five functions (and more 
likely some of these 14 variables) will undoubtedly be more or less appro- 
priate for study in open learnings team teachingt or correspondence 
teaching situations. TTie utility of this model to other organizational 
arrangements is open to question. 

Academic Learning Time as defined is in large part dependent on the 
test items selected to me^ure achievement. Task relevance was not deter- 
mined by curricular appropriateness, but by whether tasks were related to 
test items. Thus, work on study skills in reading or problem solving in 
mathj for example^ would not be coded as relevant^ if corresponding items 
were not on the achievemint battery. To the extent that many important 
curricular outcomes are difficult to measure^ this too is a limitation of the 
modeh 

Concerning the property of relevance, there is an implicit belief that the 
only important outcome of instruction related to a curriculum area is 
acquiring new knowledge as represented in terms of gain scores. Time 
spent on maintaining skills acquired at an earlier time or preparing 
students for subsequent learning is not coded as relevant ^ since change in 
test perfomiance over time would not be expected. 

Furthermore, the model rests on several assumptions. The initial one is 
that the strongest detertninant of academic achievement is the amount of 
time a student is actively engaged In learning. A related assumption is that 
considerable differences exist in the amount of time students are exposed 
to learning and in the amount of time they are actively engaged in learn- 
ing. These factors make up the quantity of schooling and vary across 
schools in terms of lengtii of the school day and year* across teachers in 
terms of allocation of time and appropriateness of instruction, and across 
pupils in terms of effort, ability, and opportunity to learn. 



^In cme enpg§d time could be goniidtrgd as a m^iure of motivation. 

However, it would be preferable to have Independent estimates of attitude, motiva- 
tion, and peer influences that be used to predigt ALT. (See figure 3,2 for an 
ex^ple of how motivation or pupU peneveimnce is r dated to time spent*) 
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The major assumption of the model is that teachers do have aii effect 
that opirates directly on pupil activity. This assumption differentiates the 
ALT model from most other rationalistic notions of the learning procesSi 
which view school, teacher, and classroom variables as having a direct 
f ffect on student achievement. 

An additional related assumption is that the amount of learning time is 
beUeved to be related direcfly to achievement. Thus, the transitive rela- 
tiondiip, teacher activity— *^ pupil activity—^ achievement, is assumed 
in this modeL 

AnoAer assumption is that aU enpged time is qualitatively the same. 
That is, 20 minutes of engaged time for one student produces the same 
achievement as 20 minutes of engaged time for another student. 

Finally, the ALT model assumes that school work can be divided into a 
number of distinct learning experiences or activities. This is a simplifying 
asaumption that ignores the possibility that material in one subject may be 
learned while studying another; for example^ that mathematics per- 
formance may improve while the student is solving quantitative problems 
in social studies or science. It also precludes a view of learning as a matura- 
tion proce^ that requires input other than instruction and study to under- 
stand the subject matter. 

The explanatory and predictive power of the ALT model rests to a large 
degree on the validity of these properties and its underlying, untested 
assumptions. To the extent that they are testable, empirical evidence 
should be sou^t to assist in evaluating the modeL 



Location of the ALT Framework in the Literature 

It is important to see the ALT frmework in felation to an extensive 
body of literature on teaching. 

The BTES general framework of instruction involves two propositions 
that, in turn, can be used to derive a third" 

1 . Teacher actions imply student learning activity; 

2. Student learning activity implies student achievement; and, there- 
fore, by transitivity one can deduce that 

3. Teacher actions imply student achievement. 

The relationship of proposition 2, student activity predicting achieve- 
ment, fits within the body of sociolopcal research on exposure to 
whooUng. The particular notion of Academic Learning Time as a proxy 
for student learning fits within psycholopcd research on learning. The 
teacher beha^ora fit within the process-product conception of teacher 
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be! 'or resaarch, using a madicd diapiosii-praseription ando©?. Apin* 
what is unique about the BTES ALT model is proposition L 

Research on exposuri to schooling focuses on whether increasing the 
amount of tima a child spends in school has a positivi efftct on his 
achievenient leviL TOs perspective assumes that leanung takes place in the 
school ^ttlng. It concentrates on the student as the active learning agent 
and is le^ concerned about differences between schools. Absenteeism, 
length of school day and year, and attendance at summer school are rele» 
vant variables expected to effect educational outcomes. Hie ALT model 
ciaarly is within the tradition of research on exposure to schooling. Given 
its particular leaming^theoretic orientation, the model assumes that in- 
creased expomire implies peater learning. Since most research in thii area 
is limited to studies of the effwts of absenteeism or summer school, the 
ALT model is more comprehensive b^ause it relates productive quality of 
schooling to environment. 

Psychological learning theorists have formulated a number of models to 
explain the process of learning and acquisition of knowledge. CarroU 
(1963, 1973) conceived of five variables that influence learning: three of 
them^aptitude (intelligence, prior learning), ability to understand instruct 
tion, and quality of Instruction-affect time needed to learn, ITie remain- 
ing two-time allowed (opportunity) and perseverance-determine time 
spent learning. Bloom (1971, 1973) \1ews learning as determined by 
student motivation and the amount of time needed for a student to learn a 
sp^ific task. 

The central tenet of the ALT framework is that pupil pursuits deter- 
mine achievement. The model relies on learning theory for an explanation 
of this causal link. Learning theory explicates how degree of learning, a 
function of actual learning time and rate of leaniirig, affects the amount of 
learning. The studies of Carroll (1968, 1973), Bloom (1971, 1973), and, in 
particular, Harnischfeger and Wiley (1975) provide support for this propo- 
dtlon. However, the ALT framework makes no attempt to explain further 
how learning takes place; ratfier it employs p^cholopcal learning theoty 
to Justify the one critical aspect of the model. Empirical support for the 
ALT model tends to provide additional evidence of the validity of these 
theories. 

The large majority of contemporary stupes on teacher eff^tiveness are 
based on a proce^-product paradlpi that defines inquiry in terms of 
relations between teacher classroom behaviors (processes) and measures of 
student learning outcomes (product) (Doyle, 1977). TTie BTES study has 
one major modification in that tiie measure of enpged learning time 
(ALT) is used as tfie "product," But the approach is still an attempt to 
develop a prediction formula like that described in detail by Gage (1963). 
Rosenahine (1971) described the basic stages of such studies as: 
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(1) the deveiopment of an insttument which can be used systematically 
to record the frequency of gertain s^cified teachmg behaviors; (2) use 
of the insmiment to record classroom behaviors of teachers and theU 
pupDs* (3) E ranking of the classrooms accofding to a meaiure of pupil 
achievement adjusted for initial difference among the classii; and (4) a 
determination of the behavion whose frequency of occurfence is related 
to adjusted class achievement scores (p. 18). 

The prociH-product paradipi contains no explicit explanatory princi' 
pies to guide the sileetion of variables or the interpretation of results. This 
is true even though specifying functional categorias of teachini behavior 
and the causal relationships between them could lead to explanatory prin- 
ciples. Nor does the two-factor structure of the par di^ incorporate vari- 
ables linking teacher behaviors to student outcomes, which mi^t con- 
tribute to an explanation of how teacher effects occur. Althou^ it is true 
that ALT is conceptually seen as an interim variable that links teacher 
behavior to achievement^ the BTES staff did not treat the data in that 
way.^ Furthemiore, since the determination of relationship between 
process variables and product has taken the form of statistical formulas^ 
any number of variables can be inserted into the equations. ITie selection 
of variables has usually been on either empirical criteria-the magnitude of 
correlation coefflcients-or on personal preferences, rather than from some 
explicit theory of teaching. "Die 14 teacher behavior variables used in this 
study clearly were derived from a combination of empirical information 
and preference. 

The fitting of ^e teacher behavior variables into the *'dia^ostic- 
prescription'' framework follows the medical analog prevalent in current 
educational writing.^ An^in (1976) describes this pedagopcal procedure 
as follows: 

The curriculum is a dlspeniary from which itudents receive medical 
tfeatmenfe under the everpfesent direction of a competent and profi- 
cient pneral diapiostician. Each patient has unique and varyini ills, but 
the diagnostician, uani precise and scientific diagnostic techniques, pre- 
scribes the proper and unique medication. Many of the remedies, con- 
ceptudized and developed by specialists, are self-administered with 
intervention needed only when rediagnosis and represcription are 
deemed ne^ssary or therapy seems in order. Throu^ the carefuUy 
conceived medical stratepm desipied from a systematically derived 
prognosis, a treatment propam is developed, void of cultish cures, 
which will aUow each patient to mature to his fullest potential (p. 63). 



8See footnote 3. 

9Some writers who use the terms "diapiosis" and "prescription" claim not to be 
foUowinf a medical analog. However, the mailings for the terms as used in educa- 
tion have their roots in the doctor-patient relation^lp (see Shrag, 1971). 
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The implications of such an analo©*^, of course, is that teaching be* 
havion should have an aura of preciaon and scientific respactabflity. 
ttapiods^prescription also implies an episodic sequenea for teaching be- 
haviors. However^ apin the BTES teaching data were not examined from 
that perspective. 

In sumrnao'i the ALT frmework assumes a um!que place in the litera- 
ture on axposure to spooling, on baming, on teaching behaviors^ and on 
instructional research^ bacausa it attempts to relate these often dissimilar 
lines of inquiry undar one aH-encompassing framework-and the k^y link is 
the conception of Acadamic Learning Time. 



Findings 

It is my intent in this section to acquaint the reader with the general 
findings and thair interpretation related to the question, '*What impact do 
teaching behaviors have on academic learning time and student 
achievement ?" 

However, before I attempt to answer this question, let me assure the 
reader that the BTES staff claim: 



L Academic learning time 1$ positivefy associated widi student 
achievement. 

2. Low success rate is negatwefy associated with student 
achievement. 

Given these major todinpi I have chosen to summarlzi the vast set of 
data analyses to answer tiie above question by describing the relationdiips 
between the 1 2 teaching variables and ALT^ low success rate and student 
achievement for raading and mathematics at both second and fifth grade. 

The relationships for tfie three dmgnosis variables were neither strong 
nor consistent. Item prediction best represented the domain of teacher 
diagnosis. Hie teacher was asked to estimate which items of a selected set 
from the BTES achievement battery the student would answer correctly. 
When teachers were more successful at this task, their students tended to 
perform better on tests. To some extent item prediction can be viewed as 
one measure of how weU the teacher knows what the students can or 
cannot do. This task presumably requires both knowledge of subject 
matters to analyze test ItemSj and awareness of differences between 
studentSj to know who can do what. Tlie other diagnosis measures, knowl- 
edge of subject matter and differentiated perceptions^ tend to follow along 
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with it^m prediction in rdationship to achievement; but the relationdiips 
are le^ strong. The BTES staff conduded- '^The teacher*! ability to 
diagnose student skill levels was related to student achievement and aca- 
demic learning time" (Fisher et al., 1978, p. 12), 

They beUevi the evidence, althou^ not always consistent, suggests that 
diagnostic abfllty probably relatei to student achievement by working, in 
part, throu^ student academic learning time. The teacher's diagnostic 
ability tos niptively related to low success rate (that is, the better the 
teacher was as dia^ostician, the less likely he or she was to prescribe 
materials that were too difficult). The diagnostic ability of the teacher was 
also poatively related to ALT, Among teachers in this sample, the better 
diagnosticians generally were Essociated with students with hi^er engage- 
ment rates. 

TTie relationships for the three prexription variables with the tiiree 
outcome measures were not consistent among ^ades and content areas. 
Only at pade five, when res^nsiveness to need was combined with flexi- 
bility^ was a consistent pattern found v^ith respect to ALT, but not witii 
achievement. 

For the three presentation variables, two were associated with ALT. 
First, explanation-need was negatively associated witii ALT. Students with 
le^ ALT receive more ocplanation based on need. Explanation-need is 
son^tently and positively a^ociatad with low success rate* 

One interpretation is that these results validate the definition of the 
variable. Students recfive explanation-n^d when they need it, when they 
are still making mistakes and do not fidly understand the material. One 
would hope, of course, that explanation would be ^ven In a manner 
tLmely enou^ to reduce overall confiision and increase the percentage of 
the time coded as hi^ success rate. Such a situation would produce a 
positive correlation between explanation^need and low error rate and a 
neptive correlation with hi^ error rate. But this is not what happened. 
The interactive teaching behavior explanation-need is a response to a 
problem. It attempts to remedy misunderstanding. It does not, relative to 
other patterns of instruction, produce superior understanding, 

A second presentation variable, structure-direct, is generally and 
podtively related to ALT. Tasks are more often coded *'easy" for students 
who frequently feceive task structuring or directions from the teacher. 
Structuring apparently helps the child recognize the task and recall the 
knowledge needed to perform the task. Providing direction may help avoid 
errors due to task format. TTie student mi^t have a basic understanding of 
the content but would stUl make errors on a task because he or she does 
not foUow specific task requirements. Giving directions would reduce this 
type of rnisunderstanding. 
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"nie two monitoring variableSs academic observation and academic ques- 
tiomng, were combined to form the single variables academic monitoringj 
dnce academic obiervation by itself was coded infrequently. For that 
vmable and the two feedback variable two strong relationdUps seem 
apparent. First, academic feedback has a clear effect on achievement. 
Students achieve more when tiiey receive more feedback about tiie cor- 
rectness of their aniwen* 

Second, task engapment feedback produces significant but conflicting 
rebtionships. With ALT the ^ttem of relation^ip is mixed. In math, task 
enppment feedback is neptively correlated with ALT, a finding that 
seems to make sense. Task enpgement feedback is primarfly neptive and 
tends to occur in response to off-task beha^or; as such, task engagement 
feedback would occur more often for students with less ALT. Also, low 
succe^ rate is positively associated with task enpgement feedback. 
Students for whom some tadcs are coded low success receive more task 
enpgement f^dback. 

After exmining these somewhat mixed results, the BTES staff com- 
bined "explanation-planned," "explanation-need," "academic monitor- 
ing," and "academic feedback,'' into a more ^obal variable labeled "sub- 
stantive interaction." ^ter reexamination of the data they conclude^i: 

More sui^tantivi mttrmetion batween the itudint and m instructQr 
aTOdgtid with hi^er I^els of leademie learning time (Fl^er et si 

Substantive inteimcdon between teachers and students consisted of 
presentation of infomatlon, monitoring of workj and feedback about per- 
formance. Most student-teacher interaction took place in a poup setting, 
^th only a smaU part of sudh interaction occurrini during seatwork as a 
one*to-one ^'tutorial" encounter. When group time was characterized by 
le vels of substantive interaction (as op^sed to organizationd tasl^ or 
waiting for odiers)^ enppment rates were hi^cr. Wien students r^eived 
more contact with an instructor during seatwork, enpgement rates were 
higher* Enppment rites were especially low when students spent two- 
thirds or more of their time in seatwork and had littie interaction with an 
instructor, ITius, thto finding has implications for class size, indi^dualized 
instruction, use of aides, and oflier grouping practices. Those aUocations of 
resources and o^nizational, arrangements tihat ^ow for mora substantive 
interaction between adult and student wfli be preferred because of the 
podtive a^ociation of substantive interaction with student enpgement. 

In summao^, the BTES data provide substantial evidence that what 
teachers do influences academic learning and, in turn, student 
achievement. 
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Critique and Implications 

I^i purpose of this section is to outline thi principd iimitations of the 
BTES framework of teacher behaviors. Drawing attention to these prob- 
lems diould not detract from the importance of the ALT framework. 
Instead it is tfie intent Uiat future efforts be directed to adapting or 
expandmg the model to encompass some of these prcblems. 

The BTES ALT model is an important step toward underitanding the 
process of student learning within our schools. The model posse^es the 
unique md attractive feature of relating institutional and teaeher char- 
acteristics to achievement throu^ the intervening variable of pupil 
activity. This teaching beha^or framework suggests several new research 
questions regarding the way behaviors of teachers within the classroom 
determine student opportunities to learn. Thus, it is also the intent here to 
suggest directions for future research. 

Limitations 

The limitations of the BTES ALT framework can be sunimarized at 
three levels-theoretical, framework, and operational details. 

At the theoretical level, the ALT model encompasses the basic limita- 
tions endemic to the theoretic^ ideas on >^ich it rests. First, the process- 
product paradigm is only loosely rekted to any macrotheory of society 
and the purpose of schools. The model a^umes there is some desirable 
product/ but who decides what is to be learned and for what purpose is 
not addre^ed. Thus, it is imbedded in a deterministic conception of 
society. Information based on such a paradipri iould be used to foster 
either ^od or bad aims. Second, Doyle's (1977) criticd analysis of the 
detafls of this paradipi points to problems that hold true for the ALT 
model. The paradipi is rooted in a two^factor structure, wliich attempts 
to produce 'laws*' that specify teacher behaviors that causally affect 
student outcome (usually determined by linear regressions). Such an ap 
proach focuses on what teachers do rather than how children respond, on 
the teacher's role in learning to the excluaon of the role of the student 
and the role of his/her peers, on frequency and stability of teacher actions 
rather than appropriateness of actions within a teaching episode, etc. 

The BTES ALT model conceptually departs from the process-product 
paradipn by maMni engaged time the dependent variable (and a mediating 
variable between teaching and achievement). However, frequency of 



lOReaders who wish to review toe principal flndinp of the BTES reseai 
rafsned to thi pre^ding chapter by Fiihef , et al. 
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tea^hirr m^om StUi is used to predict thai pupil cjULCome. for ^ more 
mmm^ discu^on of these imm, Doyli (1977), B0S!;s^gf (1976), 
Bropky and Everton {1976), Duncan and Biddla (1 974), mi Gago (J 978), 

llie cerstT^j] mtion of academic laaming timt (ALT) is ecmcepludly 
^Q)Jhd§d m CairoU's (1963^ 3973) model of ieamlpp, toi "lesimng^^ in 
hk modal is influin^il by both *'t«me sp^at" and ^Hm-i a^ded/* which m 
t^'^m are influenced ^jy Ave sp«^fft fictors: time siiow^, pefise^^iianuc* 
sptftudei ability to understand totruetiOM, wi ^judity of insiruction. 
* tefortuiiately, only -inie lUowed and tim^ spant tire weSI adirwed in the 
ALT modal. Alsa, ral^int tades. m part of how anpgtd time was 
ttiated* must be tunsldered as a proxy for q^'rUity mstruction. Ho^ w:v, 
ftw ciirHcalym tfieorists would accept ii m a good indicator uf ^iity. 
Falure consider the other ftctoo a^id their Influenoes oti Soajrnl^ig is a 
serious Ui^iiration. 

Althou^ the 6is.^mtic-pmmpuSQ ftain^woik lisod to Icfcntify 
teacher h^^mvion is currentiy pop^ihir^ the Irihsieitt limitatioiis of iinm- 
lating the analogous OmtoP^Mfint mWioniidp into teaeher- 

student has been ^ell do?^U'r?fg^itftd (in paftiCiaiar see Schrag, 1971). 
For ixampta, if a pati^Ti^ hm a sore throaty boft dimter and patient are 
awari ^^f the problem. 'ThB patient knows what it is like to be well and 
wants to ^ "K- Vm doctor s job is to prescribe a procedure among 
altenistives for cho paiient to follow to regain health. h\ toaching, the 
student in ay not be^ aware oi 4 le^minf ntad. For example, g/he has never 
knoTO how to solve a qyadiatic equation or what it is like to solve one, 
nor may s/he want to learn. Thus, the teacher's Job goes well beyond that 
of a iimple diaffiodi-prescription link. Furthermorep in tfie literature on 
teaching, Hiebard (1972) has idfe/sdfled Aree metaphors, oUier than the 
medical analogy, to describe the role of teachers in schooL One way of 
mimmarizing these ide^ is to use Romberg's (1 974) adaptation of Perrow's 
(1969) organize clonal theory to explain social types. 

Perrow identifiyd two dimensions that underUe most organizations. The 
flrst is related to the assumption one makes about the unifonnity of raw 
materials entering the o^anization. I^us, in schools, students may be 
aMUmed either to be uniform or variable in terms of capability* The 
second dimension relates to the a^mption one makes about how well the 
process for transfoiming this raw materid into a Bnidied product is under- 
stood. For schools, this mwis how well the instniction^ proce^ is under^ 
stood (see figure 3 J). The traditional school is a highly routine organiza* 
tion, where it is a^med that the nature of the leanUi^ process Is well 
understood and students are perceived as unifonn. Its historical roots in ' 
the United States ^^an be traced to the be^nning of the 20th century, 
when mass education was initiated (Cremin, 1964). 'Die bureaucmtic school 
or^nization ^s seen as a means of organizing and controlling educational 
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enterpriie. The eurriculum in a traditiond school has been mitaphoricd^ 
d^ribad by Helbtfd (1972) as a m^ns of production where the student 
is the mw material* which is tfansfonned into a flni^ed and useM 
product under control of a hi^y skfllid technician. In the clinical 
school, the nature of tfie learning proc^ is perceived as not well under- 
stood, witfi few, if any, weU-^tabliAed instructional techniques for en- 
suring succesi- Tlie curriciUum in this school cm be described ai the green- 
hou^ where studenti pow and develop to their fuUest potential under the 
care of a wise and patient gardener OOiebard, 1972). Tlie academy sdiool 
a^mes that little is fcftcwn about the nature of the instruction^ process; 
therafoies teacUni is more art Aan science. Yet students are coi^dered to 
present urifom?. problems that the teacher must addre^. l^e curricidum 
in this school ii a route over which students travel under tiie leade^ip of 
an experienced guide and companion ^ebard, 1972). In tiie ^sterns 
school it is a^med that the nature of Ae insteuctlonal tide is well under* 
stood, but chadren are conMdered to have a vride range of abflities. The 
curriculum in tWs schod is a topen^ from whidi students receive 
mediod tregtments under the ever-present direction of a compet^t md 
proflcient general flapiottician (An^, 1976). Altiiou^ dl four schod 
types and comsponding metaphon have serious limitations, picWng one at 
exduaon of the otiiers is unwarranted. Eventually, a comprehensive 
theoty of teachtag mmt evolve to encompaM tihe appropriate ch^acter- 
Mqb of ^hooling derivable from each persp^tive. 

At the framework level, one specifies the particular major components 
(sudi as prescription, feedback, or pupU actions) and how they are related- 
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The major limitation of BTES ALT framawork at this level is a matter 
of omisdon. To simplify the compleKity ofclaMrooms, certain factoid ara 
^liGtid and othirs omitted. Future efrorti to look at the teaching-learning 
proce^ based on the ALT model must attend to factors omitted from the 
modd. In partcular, four omi^ions seem to be readfly apparent. First* 
quality of instruction as posited by Carroll is not included^ but it could be 
approadied from a curric^um content perspective and then used to define 
relevance. 'Die cuniculum plan and the activities the teacher has decided 
on, rather Aan test items, should be used to define relevance. Second, 
scding of teacher activiti^ shoidd be derived from a notion of instrucdon 
that attempts to capture the episodic nature of teaching. Frequency of 
behavior is le^ important than timing, TOe number of explanations pven 
is not as important as when an explanation is pven. A wel^ted or Boolean 
scaling procedure needs to be included so an index of appropriateness of 
teacher behavior can be used, ftird, no motivadonal factor is explicitly 
included in the moders diapiostic-prescriptive framework. Assessment of 
what teachers do to motivate students and whether students are indeed 
motivated diould be included. Finally^ of partic^ar importance is the 
documented iffect of peer influences on the learning process. &cial rela- 
tion Alps are one of the central concerns^ as chMdren*s de^re to attain or 
maintain membership in a clique or reference poup motivates many of 
their behavior, TMs need for socid affiliation can dramatically aff'ect 
students' efforts to le^, hinder teachers' efforts to instruct, and affect 
the way chfldren and tiieif instructors spend their time in schooL If the 
model IS to be a re^stic representation of the learning proce^, the power- 
ful variable of peer influences must be incorporated into the conceptud 
scheme. With these and undoubtedly other changes a more dynMnic model 
could be created. 

At the operation^ details level, a number of improvements could prob- 
ably be made in tiie construction of variables, I will not attempt any 
detafled criticism of these operational decisions, Mnce at the time the 
decirions were made they seemed reasonable in temis of the intellectual 
and financial resources avaflable to the BTES staff. 

In summary, the BTES ALT framework and the study based on that 
framework are importait conMbutions to the study of teaching. The 
limitations I have outlined diould alert researchers and educators to the 
next steps that need to be taken. 

Since learning is a process that develops in time, a subsequent model 
Aould be one b^d not only on tiie ALT ideas, but also on an attempt to 
explain learning and predict outcomes in a dynamic sense. OiJy in this 
way can complex relationships among the several relevant influences on 
students be iUus^ated* TTie creation of a comprehenave tiieoretical model 
of teachini and leammg, formulatid as a dynamic causal process and 
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tested on hi^ quality lon^tudinal dita, remains a long-r 
saarchers and educators. 



Implications 

I am conGluding this chapter with a few commen implications 
of the ALT framework for researcherij school ad^ rSs teache 

teacher tralnerij and educational policymakers. ' principal 

value is heuristic: by focusing on pupil activity it snoL haw tt: 
attention to new questions. 

For researchers^ the chdlenp is to clarify how instil ^ larai u ^ 
istics of schools influince pupil activity enpiemf ' in a ( in 
particular, althou^ the BTK staff members hav^ made on- 
tribution in restricting theLr conceptualization of te^^ching ior o five 
priaric teaching functions, researchers ihoiUd attempt to ex clarify, 
expend, and falsify tiiese functions as part of a causa' model oi .ruction. 

For sch^l administratorSs Ae ch^enge is relat to thaiT . tioni and 
procedures to increase student enpgement. In partiw -^r, lliyie is a lot of 
anecdotal information about school operating proceduriSj such as sched- 
uHngj wait time^ and loudsp^ker announcements^ that detract from 
enppment. Also^ pupil engagement potentially could be used as a 
criterion for evduating teachers. Clearly, some teachers are better at 
getting and keeping pupfls on task than others. Before this could be done, 
however, soma decision would have to be made about the quality of 
eiigagid time. 

For teachers, tiie challenge is to judp their own activities wiA respect 
to how weU tiie activities keep students enpged, to observe more closely 
whetfier students are enpgedj and to adapt their behaviors accordingly. 

For teacher trainers in both preservice and inservice programst the chal- 
lenge is to reflunk tiie content and emphases of cunent courses and pro- 
grams* The Bras work has shown that one important aspect of teaching is 
resource management: in particidarj manapng time. Propams of the 
future must include this important component. 

For educational policymakers^ tiie chdlenge is to andyze policy issues 
in terms of implications on pupl enpgement. ^so, since there is a finite 
amount of time to be ^located to instruction , the BTES work rfiould 
force policymakers to recondder tiie purposes of schooling and the social 
needs Aat schools can reasonably accommodate. The numerous demands 
on schools to include peater content cannot be met urUe^ oAer content 
is eliminated. 

In conclusion, the BTES staff has reformulated the problem of how to 
study teacher effectiveness by chan^g the focus from factors associated 
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^th achiivemfnt to factors that m^imize students' enpgemint during 
initruction. ITiis essantisl big step forward now net ds to be continued* 
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American pubUe eduQation m eurrintly experiendng unparalleiid ax- 
tam^ interventions into its internal matters. School pirsonnel in about 
three-quartars of tha States m fadng ligisladve mandatai to "clean up 
their act." Typicdly, these mandates take tha fonn of demands for 
nunimal proficiency or compatency testing ^iphoj 1978): educators are 
charged to test students for particular "profidanciis" or ''competencies" 
prior to promotion or paduatiom And occasionally the mandates take the 
form of demands for com^tency-based education (Spady, 1977): aduca» 
tors are charged not oi^y to test aU students for competency but to teach 
tiiam for competence as weU. 

At the heart of the thintdng that has led to these external interventions 
has been tha concept of faflure rate* Public ^ool students seem incompe- 
tent to many outdde observer, and the problem appear to be getting 
wor^* If these intarventions are to be stemmed, therefore, our public 
schools' faflure rate must be cut. 

lUs chapter condders one simple approach to the accompMmiant of 
th^ purpose— a variable that BTES researches have cdled success rata. The 
diapter d^ribes tha triable and some of the major BTES flndinp perti- 
nent to it. Then it indicates sava^ of tha most salient education^ features 
of succass rata. 

Let ma be clear from the outset I intend to take a podtive stance on 
Ae value of the siic^si rate variable for cw«nt edu^tional tMnldng and 
practica. Indeed, in some ^ses my stance is apparently even more positive 
than that of the BTES reiear^ers themselves, 

I take this podtiva stance not because I am a BTES indder; in fact^ I am 
an independent outdder and one who has sever^ substantive reservations 
m to the long-tann motivation^, or diould I say unmotivational, impUca- 
tions of the succeis rate flndmp. I take the stance becau^ of a current 
malaite or pesdmism in the field of educational i^saardi Aat has exduded 
many usef^ thaoreticid developments from readiing the field of edu^- 
tlonal pmctice. The suc^^ mta variable and flndinp, to my mind, have 
many educational insists to offer the practitioner. I leave to otiiers the 
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ea^ task of dDCuniinting what ia wrong with them; I intend to tackia the 
harder task of exploring what is right, 

A Deflnition and Some Findinp 

"Sucwss rate" is one of several variables compriiing a measuri that 
BTES researchers cdl Academic Learning Tinier or ALT for short. Spe cifl* 
caUy, **iuccais" relatis to the appropriateness of the academic learning 
tasJa on whidi the student spends engaged time. 

BTES researches defined three "success rates" at which students can 
spend time in the ola^room: mhigh one where the student spends time on 
tasks that s/he finds v^ry ^my and can readily master; a moderate one 
where the student spends time on taste that s/he finds somewhat easy and 
can partially master; and a tow one where the student spends time on tasks 
that s/lie finds very hard and can hardly master at all. 

Hie BTES research suggests that aU three rates affect students. The hl^ 
ratei and in a more uncertain extent the moderate one, have a positive 
impact on student learning, whereas the low has a neptive impact. The 
hi^ rate also has a positive impact on student attitudes toward the subject 
matter learned and towani school. 

More over j the research results suggest that success rate can be con- 
trolled by the teacher throu^ the routine execution of certain generic 
activities* ^e such activity I would label diagnosis: the accurate pre- 
diction of each student's future perfo nuance based on her or his present 
md past hist 00^^ Another I would caU prescriptions the provision of 
appropriate learning talks for each student based on the teadier's diag- 
noas. A third I would term orientations the clarification of each learning 
task for each student in terms of what is to be learned and how it is to be 
learned. The fourth I would desipate feedback: the pro^sion of constant 
information to each student regarding learning progress. The fifth 1 would 
name correction: the provision of timely supplementary instruction for 
each student whose learning progress is insufflcient. 

Some Features 

Now that we know what success rate is, let us consider five of its most 
interesting features. We can label them as follows: Success rate is a quality 
oflemning time variable; a success ^^riabla; a rate variable; a manipukble 
variable; and a mastery learning variable. 

Quality of Student Learning Time Variable 

One interesting feature of the success rate variable is that it is a quality 
of student learning time variable. Wiereas the other components of ALT 
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(namely, aflocated time and enpgemint rate) attempt to indix the quan- 
dty of time that students spend actively enppd in learning a particular 
subject, suca^ rata attempts to index the quality of that time. Speci* 
fically, it taps what itudents are actually doing during their engaged 
academic time. Wiat BTES researchers are saying throu^ the variable is 
that educators can indeed help students to leam better by finding more 
time for arademic matters. We can have even more impact, however, if we 
find more time for more appropriate academic matters. 

This message is refreshing in two respects. First, it helps to redress a 
current imbalance in educational thinldng regarding the role of time in 
student learning. The peat bulk of this thinldng has concentrated on 
manipidation of the quantity of time that students spend in learning (see, 
e.g.. Berg's chapter). Manipulation of the quality of that time has been 
little examined despite evidence that the quality is just as important as the 
quantity (see, especially. Block and Burns, 1977; Proceedings of the Nil 
Invited Conference on School Organization and Its Effects, 1978). 

Second, the me^ap challenps educators to rethink not only what they 
teach but also how they teach it. Wstorically, we have tended to desi^ 
our academic curricidums and instructional methods so they were 
educator=appropriate. This meant that many leaming tasks were irrelevant 
from the students' pei^pective (Bloom, 1976) and were taught as if 
students were already experts (Glaser, 1973). The BTES success rate flnd« 
ings stron^y suggest that we must pare our current academic curriculums 
and instructional methods so they are more leamer-appropriate. We must 
strive to ensure that virtually all of our leaming tasks are as relevant as 
possible from the students' perspective and to remember that our students 
are no\dces. 

Success Variable 

A second intriguing feature of the succe^ rate variable appears in the 
first part of the label itself. Success rate is a success variable. VWiat the 
BTES researchers are saying through this variable is that if educators want 
better learning and better learner feelinp, then they ou^t to offer 
students more leaming success and fewer leaming errora. Indeed, as if to 
emphasize this point, they even changed the variable's label from "error- 
rate" in the earlier technical reports to "success rate" in the final ones. 

This focus on success is noteworthy because it places the BTES re- 
searchers squarely in the camp of a growing ffoup of educators who 
optimistically believe that schools can make a positive difference in most 
students' inteUectual and emotional powth. These educators take the view 
that each student can leam weU if s/he is tau^t sensitively and, hence, 
that no student need make leaming errors. Consequently, they contend 
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that our public iducation syitams ought to provida relatively ertor-frse, 
preventive leaming environments for each student rather than error»full, 
infective ones. Since an error-frie learning invironment is a successful one, 
they press* in short, for schools designed around the idea of learner 
success. 

At first glance, it may seem strange that any modem educators must 
press for this idea in the desip of public school learning environments. 
The idea is, however, relatively new in terms of public education planning. 
MstoricaUy, public schools in the United States have been built on the 
assumption that not eveo^ student can learn well and, hence, many 
students must make learning errors (Bloom, 1976). Accordingly, schools 
were desipied to dlow these many error-full learners to distinguiih them- 
selves from their few error-free peers. Most students, rather than being 
pven chance after chance in our public schools to demonstrate leaming 
success, were pven chance after chance to demonstrate leaming 
mediocrity or failure. Wiat better way to find a few error-free learners 
than to pve the many error-ftiU ones ample opportunities to reveal their 
flaws? 

It has only been in recent years that education researchers have begun 
to understand fuUy the costs of such error-pronioting systems of public 
education. Several scholars have found them to be intellectually and emo» 
tionaUy pernicious to many students. Bloom (1976), for example, has 
documented how they inhibit students* academic and penonal develop- 
ment. Indeed, his work sugests that most students in such systems leave 
school not only unable but also unwilling to undertake the lifelong leam-^ 
ing required to maintain a decent standard of living (Block, 1971a), And 
other ^holars have found error-promoting systems to be equally per- 
nicious from the standpoint of many teachers and administrators and the 
communities they serve. Consider school staff morale: I have observed 
such fystems bar many teachers and administrators from the chance to 
attain perhaps their most prized professional reward; namely, the knowl- 
edge that they are making a difference with students. ITien, I have 
watched these systems make the teadiers* and administrators' profe^ional 
lives more demanding to boot. Such educators must pve special attention 
to a wider range of learner management problems, Th^y must, for ex- 
ample, "indi^dualize** their instruction in the face of unnecessarily wide 
ranges of individual differences in students' readiness to learn. This 
typically entails redoing portions of their predecessors' jobs as well as 
trying to do their own. 

Consequently, it has only been in recent years that some educators have 
called for replacing error-promoting systems of public education with 
error-priventing ones. These educators feel that the latter systems liberate 
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moit studinti mtiUicturily and emotionally^ since they focus on devel- 
oping talent in aU learners rather than on identifying the lack of talent in 
most learners. Bloom (1976), for example, writes: 

the educational wyst^m can be i lelf^orrecting iy§tem so that errors 
madi at one time can he corrected before they ire compounded ^th 
later errors. 

In effect, a self-con^ting ^item of ^hooUng can b^ome a minlmiil- 
error ^sttm of education (Insofar gi learning anon may be r^uc^ as 
they oocur) with consequint pofltive effects on students* affecthra and 
cognitive chancteristics , , ^ « Wi have made the point that much of 
Individual diHerences in learners are the effects of a system of schooling 
which is fuQ of errors. A minhnal^Ror (or error^orr^ting) ^stem of 
schooUng may approach the effectiviness for learning of a system of 
tutoring in whicli a highly pfted and sensitive tutOf inteotcti with one 
student at a tmie (pp. 2il'212). 

These educators also see the error-preventing systems as being equally 
liberating for teachers, administratorii and the communities they serve. 
For example, such ^stems are \iewed as one way to improve school staff 
morale. Exemplars of such systems, suoh as mastery learning stratepes^ 
pve staff membeii the opportunity to have a consistently positive impact 
on their students (Block and Bums, 1977). 'Hius, they make educators' 
profesdonal Uves more rewarding while at the same time helping them to 
face the demands of dieir jobs better. For example, at a time when 
teasers and administFators are increa^^y asked to be "accountible" for 
student learning, such ^sterns can provide practitioner with the tools 
needed to^ischarge the responsibility (Block, 1973; 1977). 

Rate Variable 

A third noteworthy feature of the success rate variable appears in the 
second half of the label. Success is a rate variable. Wmt ttie BTES re- 
searchers are saying to us educators is tiiat if we want to produce a genera- 
tion of truly learned students, then the leaniing student cannot experience 
succe^ it only a few milestones in her^s career. Each must experience a 
constant stream of success. 

This rate conception of success is interesting primarfly because it is so 
alien to the way success is currently distributed in the schools. Even educa* 
toil who want students to expirience success allow them to do so only 
pariodicaUy. For them, success is like ^unthood, something one earns only 
if s^e has been very good for a long time. 

Condder, in particular, oommon pading practices^ even the best 
students are given only intermittent feedback about the suc^^ of their 
learning. First, they in socialized to believe that all that counts Is public 
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indieation of how wt U they have learned relativa to their dasimatei* Hien 
they are given only periodic public opportunities to distinguish themselves 
from their peers. And finally, they are told that even these opportunities 
count only partially, Miat really counts are their And grades! Thus, it is 
only after an entire quarter, a semester, or, in a fev/ cases, an entire year 
that even the best students know where they stand. 

The BTES researchers' rate of conception of success clearly challenges 
this ascetic mentality on rewarding success in public schools. The success 
rate variable encourages educators to provide continual rather than 
periodic feedback to students about the excellence of their learning. And, 
just as important, it encourages them to couch this feedback in terms of 
the material to be learned. It helps th^ student undentand that success is 
not an external concept, dependent on the learning of others, but rather 
that it is a more internal concept, dependent on one's own learning. ITie 
student can, therefore, earn success any time s^e chooses; s^e need not 
wait for a special competitive time the teacher chooses. 



Manipulable Variable 

A fourth interesting feature of the success rate variable is that it is 
manipulable. In particular, the variable is educator^controlled. Wiat the 
BTES researchers are saying throu^ this variable is that If educators really 
wish to promote student intellactual and emotionid growth, they have one 
means readily at hand. 

This feature is intriguing because of the mode of educaUonal problem 
solving it reflects. It mi^t be called the "can do" approach. This approach 
is based on die assumption that central educational problems can be 
solved, and that many of the solutions are to be found in educator^ 
controlled variables. One explores how far the problems can be solved 
through manipulation of these variables before looking for solutions be- 
yond educator control. 

Contrast this approach with the currently fashionable mode of educa- 
tional problem solving— the "can*t do** approach. This approach, too, is 
based on the assumption that central educational problems can be solved; 
but here the solutions lie in variables beyond educator control. One ex- 
plores how far the problems can be solved through manipidation of these 
variables before looking for solutions within the educator's control. 

Educationally speaking, the former approach is eminently <more reason- 
able than the latter one. It leads educators to think about problems in 
soluble rather than insoluble terms. Think, for example, of the plethora of 
central educational problems that recently have been considered in terms 
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of wriables that are essentially beyond direct educator control. It is diffl- 
cult to peruse idudatlonal literature or attend educational meetinp with- 
out constantly hearing variables such as sex, race, locioecononiic status, 
the family, or governrnent regulation invoked to explain our educational 
woes. Recently, for example, I read a Los Armeies Times article on the 
problem of opening admissions to colleges and universities to a wider 
range of individuals. Eisentially the argument advanced was that wedth, 
race, sex, and geopaphy were the major factors contributing to closed 
admissions and, hence, the solution for open admisslDns was for educators 
to somehow manipulate these variables. Nowhere did the article consider 
that these variables may be e ducat) ^n^y unmanipulable! 

The "can do" approach offers educators some hope. As I have criss- 
crossed the country on professional business^ I have noted a digtinct sense 
of powerlessness among educators, a mnm that seems to be spreading* I 
believe this sense will continue to spread m long m educators continue to 
andyze centrd education^ problems in inioluble tenns. The "can't do" 
approach invariably attributes our problems to exogenous forces over 
which educators have little power. Miat hope can they have, then, of 
doing anything to improve their lot? 

Of course, aU central problems in education cannot necemrily be 
solved by variables that educators control. But they aU can be conceptu- 
alized in these terms. TTiese conceptualizations can than be tested (just as 
the BTES researches have tested theirs) to see how far they go toward 
soMng the problems. My hunch, after a decade of **can do" problem 
solving in teaching and testing, is that we can get very far indeed. 

Consider, for example, the inordinate problems of classroom manage- 
ment and discipline. Suppose that rather than viewing these problems as 
stemming from forces outride educator control, such as the lack of disci* 
pline at home, we thought of them as being caused by forces within our 
control. In particular, suppose we idewed them as being caused not by the 
mismanagement of learners at home but by the mismanagement of learn- 
ing at school. We could dien attempt to solve the problem of learner 
management by using techniques of learning management. Carroll (1971) 
has listed some of these techniques^ 

teiehing ought to be a simpli mitter if it is viewed as a precisi eon- 
cernid with the nmmgmtnt of learning , , th€ funetion of thi teicher 
m to ^gdfy what is to be leirned, to motivate pupfls to learn it^ to 
provide them with Imfructiond matariili, to administer these letming 
materials it a rate suitable for each pupili to monitor students' progress, 
to dia^o^ diffloultiii uid provide proper remediation for them, to 
pve pri^ and eneourapment for good performance, and to ^ve re- 
view and praetiee that ^1 mmtain pupHs' learning over long pfriods 
of time (p^ 2^30), 
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In my expirienee, the rilitionship between management of liarner 
problimi and management of learning problems has always been direct, if 
complex. T^i fewer learning problems, the fewer leamer problems* But 
one neid not take only my word; other scholari have found much the 
same. As a case in point, the BTES researches themselves found that high 
success rate was a^ociatad with better attitudes toward the basic subjects 
of reading and mathematics and toward school. 

Mastery Learning Variable 

TTie final interesting feature of the success rate variable may be, practi- 
cally spea^g, its most important one. Success rate is a masteo^ learning 
variable. That iSj it is a variable that can be ^stematicaUy manipulated in 
the classroom using so=cdled "mastery learning" strate^es* 

This feature puts at practitioner' feet some readymade and proven 
means of improving their success rate. Hiey need not waste time building 
such means from scratch. Moreover, this feature ^ow them to improve 
not only their succe^ rate but dso the other facets of ALT— that is, 
allocated time and engagement rate— as weU* Hiis is because mastery 
stratepes are systematic approadies to instruction that provide Ae class- 
room teacher a framework for orchestrating and executing those five 
generic teaching behaviors— which I have labeled diagnosis, prescription, 
orientation, feedback, and correction-that the BTES research has diown 
to improve ALT and, hence, student learning and attitudes. 

Essentially, dl mastery learning stratepes are desiped around the con- 
cepts and techniques indicated in figure 4. L Space precludes a full dis- 
cu^ion of the figure, so the foUovsdng account must suffice. The reader 
who widies a fuUer account is referred to Block (1971 b), Block and 
Anderson (1975, 1977), Block and Bums (1977), Bloom (1976), and 
TorAen(1977), 

Gmerd aomideratiom. M mastery strategies, whether of the poup- 
based/teacher-paced variety or of the individudly basid/self-paced kind, are 
deagned to help >drtudly ^ students learn as well and as fast as only a few 
students currently learn. At the heart of these strate^es is the view that 
each student's instruction must be approached systemati^lly* 

Systematic instruction for the mastery practitioner entails the building 
of a bridge between what the teacher wants to teaA and whom s/he wants 
to teach. First, the instruction is matched to the course outcomes the 
teacher is seeldng. Thh means that the teacher's instriKtion will be 
outcome-based* Then the instruction is matched to the specific learners* 
'Ms means that the teacher's instruction will be multimethod; each 
student, within some Hmits, can reach the course outcomes throu^ those 
methods best suited to her/his learning reqirfrements. 

Ill 
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Ffgim 4.1. Abstey LMnbig - How Do^ It Work? 



Oeniml 

mstruQtion AoiUd pimiAe bridge 
between leamen and outcomes 

Spedfio: ^eondittoni 

B. Define diif^omtj 

C. Provide for spproprtate help m learning 

D. Provide for eppFopHste learning time 



SpeMoi Operating pro^dures 
£. Provide student ortentgtiQn 

F. Vary how and how long each student 
Is teught ai nyoesJiry 
Grade 



Te^nigues 



Base initfuetioit on outeomeir 

Ptovide multiple instruetional 
methods 



Define mastery and make it 
expUdt 

Prededpi instiustian for 
maiter^r 

^desi^ instruction for 
mastery 



Orient students to mastery 
learning 

Teaeh for mast^y 
Grade for mastery 



Sp^ciflc constdemtions: preconditions. Hit mastery practitioner begins 
by executing a sariis of acti^tits outiide of diss. Hiesi activities are 
Oillcd thi pifconditions for mastify liammg. 

lilt first pricondition the teacher must satisfy is to deflne the learning 
outcomes i/ha pursue^ Obnously no af^roaoh to instruction can ba 
outcome^baiad if thi outcomes on which it is based are undi fined. 

Outcome defmition is a two^stap process^ Fl^t, the temdier diflnis 
what course misteo^ will mean, Sfh$ determines what all students ^1 be 
^pected to attain and at what levels; i.e.| the course masteiy uistructlonal 
objectives and mastery pe rfomiance standards^ Second, the teacher makes 
expUdt thii defliUtion of mastery, Masteo^ instructional objectives ^d 
performance standards w put on ^per in sudi a ^y that they dearly 
conimunicate to the teacher what must be tau^t and to the student what 
must be learned. T3npicallyp the objectives ve converted into an appro^ 
priate objective-based or "criterion-referenced** CPophamj 1978) cou^e 
fiml exanunation and the rtandards into And exaniination scom indica^ 
dve of ex^Uent perfonnance. 

ThB second precondltioit the teadier must meet is the pro^sion of 
a^ropriate help for each leameT, Mastery Aeoiy proposes that student 
learning errors often stem from uncorrected errors made at an earlier time. 
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So mastiiy praetici tttimpts to prevent litir lianiing errors by idintifying 
mi correotmg eumnt leambig irrois ai they ocmt. 

Thii privention is iccompUihid ftrou^ the predasipi of the teaehar*! 
inrtruction. First, the teaAer bi^ala thi entire coursa tnto rou^y % or 
3-week leammg units. Next, sAie hierardUcaUy sequences these umts so 
tha materid in one unit conastentiy transfers to that in the subsequent 
uiUts. Finallyi s^e formulatas a plan of initruetion for itgh unit conristing 
of tiirt e partst tiie ori^al instruction portion mdicates how tihe imit's 
materid wiB be taught inltidly; the feedback portton pro^des a diagnostic 
program check on each student*! learning from tha origmal instruction; 
and the corriction portion provides a varied of instructional alternatives 
to the oripnal instruction^ 

The final pfecradition tiie teadier must tackle is the provision of ap* 
propriate leaming time for lach learner. Mastery theoty proposes that 
virtuiOy aU students can learn weU if they are pven enough time to learn. 
So mastaiy p^ctice attempts to make sufflcient leaming time avmlable. 

This precondition is abo met through the predeapi of the teaaher-s 
instruction, Typic^y the teacher proceeds ^ follow. First, s/he deter- 
mines how mudi ttae i$ to be spent on Ae oiigmd instruction, the feed- 
back, and the correction for each unit. This is called the located time. 
Then, s/he compares tiie dlocated time ^th the calendar time ^avaflable 
for the course, Fin^y, s/he adjusts the located time to fit tiie criendar 
time, Usudly, this adjustment occui^ in three stages. In the flnt stage, the = 
teacher borrows time from the later units and adds it to the earlier ones. In 
the next stage, the teacher uses this borro^d time to ensure that the 
correction portion of the course*! early units ocoun In cla^. This bor- 
rowed time will serve to drive home to students the idea that correction of 
leaming errors is important In the final stage, the teacher decides to use, 
as necessary, out-of-da^ time for the correction portion of the course's 
later units, E^ntiaUy, s/he simply plans on a^iping the correction por- 
tion as homework for those who need it« 

Speciai considemtion$: opemting procedures. Th$ mastery praatitioner 
is now ready to enpge in a series of activities In the classroom based on 
Ms^er plaiming outdde of class, Tliese acti^ties are c^ed the operating 
procedures for mastery learning. 

Since leaming for mastery is likely to be a new experien^ for most 
students, the first operational task the teacher faces is student orientation. 
Obviously, no new instruction^ technique can succeed if the groimd in 
which it is planted is not properly prepared, 

The teacher typicaUy tacWes the orientation task as follows, SAie be- 
^s by telling students speciflcaUy how the cour^ is to be tau^t; that is, 
that the whole coui^e wU be tau^t in a sequence of units, that each 
student is expected to master the material in one imit of the sequence 
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befori att^mptog the next, md that Qirtain ftadbick/corraatlon proci- 
diifes iaHI he usedj as naciisa^, to uMist students in tMs anterprisi. The 
tiachtr then teUs students^ ag^ ipaQifladlyt how couna mastiiy ^ bi 
diflnid; that is, what thi conrig*s mastity instnictiond objacttvis and its 



saoond opamtional task tfii teacher encounten is tea^ng each 
imit for mait@o^. Conceptu^p this means that the teacher muit dmply 
vary how and how long each student is tau^t according to the unit's 
instnictional plan, 

Hie teacher bepns by executing the unit's origind instruction tech- 
niques^ Hus ^ves ^ itudents a chance to learn from the same method of 
instruction over the same period of time. For some students, this method 
md this time are sufficient to master the unites materids. ^e teadier then 
executes the unit's feedback tediniqueSs which pFO\dde information as to 
those students for whom the ori^nal mstructlon and learning time were 
sufficient and those for whom they were not. For these latter students, the 
teacher next ixecutes the tuiit-s correction techniqueSp Each one is given a 
prescription based on herAiii particular diapostic-propess residts. 'nUs 
prescription directs the student to specific alternative methods of instruct 
tion whereby s^e mi^t maiter the material not mastered from the 
oripnal mstruction. Moreover, it indicates where— mside or outside class- 
the additional learning time required by these dtematives mi^t be spent. 
The tether fmafly indicates when Ae ori^d ^struction for the next 
unit wUl be^. Those students who require correction then have the 
interim to correct their particdar learning problems with those instruc- 
tional alternatives best suited to their learning requirementi. 

Ihe find operation^ talk the teacher faces is grading. Since students 
are not formally graded on each unit of tiie course, they must be graded 
across all units taken as a whole. 

This task is iccomplished by pading students against the definition of 
course masteiy ^t out on the first day of dass. Students are assessed m to 
whether they have or have not attained each course masteo^ instructional 
objective to the appropriate masteo^ perfonnance standud. They are not 
asiassed as to how weU they have acMeved relative to ^eir peers, Hius, 
each student's pade depends only on her or his accomplidmients and not 
on the accomplishments of her or his cla^mates. Moreover, it depends on 
tile same learning conditions tiiat were apparent Uirou^out tiie course. 
The stu^nt is agMn in competition ^th himself and the material to be 
le^ed rather than with colleagues. If s^e has consistently won this com- 
petition at the unit level, s^e dso vAn this competition at the course 
leveL Tlie grade mil only pro^de public recognition of what s/he has 
taown privately for some time-**! have learned weU," 



m^tei^ performance standiffds are* 
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The mastery learning teacher typically awards only two grades. One 
grade is indiaative of masts^ in the student's learning and is awarded to all 
students who have demonitrated mastery* Often this pade is equivalent to 
an Aj for mastety meaj?^? vXcellenee, and exeellence is not reflected by B's 
or C% Tiie other ffBSh is indicative of nonmastery in the student's 
learning and is given to all students who have not demonstrated mastery* 
TOs prade is typically equivalent to an 1 (Incomplete) for nonmastery does 
not mean that the student is incapable of demonstrating excellence in 
learning. It simply means that the student is capable but has not yet 
demonstrated this s^tceUence* 

Sumnfiary 

This chapter has considered one simple avenue to be^ cutting our 
public schools* hi^ and powing rate of failure. The avenue is a variable 
that BTES researchers have called **success rate." 

Tlie chapter began by describing this variable. It pointed out that 
success rate m one of several variables comprising a measure called Aca- 
demic Learning Time (ALT). "Whjle the other components of ALT focus 
on the time students spend enpged in certain academic learning taskSj 
success rate reflects the appropriateness— hi^i moderate^ or low— of these 
tasks. 

The chapter then summarized some of the major BTES flndings perti- 
nent to the variable. In particular, it focused on the positive impact that 
high swcess rates can have on student learning and learner attitudes. It 
also emphadzed the fact that success rates can be teacher-controlled 
throu^ the routine execution of five generic teaching activities: diagnosiSi 
prescriptions orientation, feedback, and correction. 

Finally, the bulk of the diapter discussed five of the variable's most 
salient educational features. Specifically, it contended that success rate is a 
quality of student learning time variable, a success variable, a rate variable, 
a manipulable variable, and a mastery learning variable. The first feature 
says to educaton that we can indeed help more students to learn better if 
we find more time for more appropriate academic matters. Th& second and 
third features teU us that such matters would be ones from which students 
experience a constant stream of learning success rather than learning 
errors. And the fourth and fifth features suggest that we have the power 
and the means to provide such matters already in our grasp* 

Ihese are exciting features, for they gjve educators some hold on the 
destiny of our public schools. True, these holds may be small and tenuous, 
but they are real nonetheless* If we want to maintain some say over the 
course of public education in this country, we must use every hold we can 
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How Time Is Spent in 
Elementary Classrooms 

Barak V. Rosmshine 



Tlii Bcgmning Tiadiir Evgluation Study providis us with vduabli 
infomiition on how tima is spant in elgmgntao^ classrooms, Somi of tiiB 
major topics are^ tiii avirage iranutis day wWdi studants spend en- 
ppd in reading and math acti^tiai, student tnppment rates in diffarent 
settings (that t@aehar4ad ^ttinp varsus saatwork) mi suggiitions on 
how itudant angagamant rates might be raised. At tiii sama timai BTES 
and simflar stu^^ dso help us luidantand tha Uniitations of incraasing 
anpgad minutes in alissrooms. 

Caution! Tlia lasulti diould ba read with caution to avoid imsintarpTe- 
tation. Hia Be^nning Taadier E\^uation Study was Umitad to tha investi- 
ption of instruation ui raiding, languaga arts, and mathamati^ in s^ond 
and fifth grades, Hia students we^ ^dthin the avenge ranp-from the 
25th to the 6Sth parcantile on the pratasts-bri^tar and very dow 
studants were not includad ui this study, ^thou^ ttie fooui hi this study 
is on Sasio ddUSp one ^odd not eonolude that tiie antire day diould ba 
davotad to uistruction In thasa sl^s, Althou^ the foaus m on acadanuo 
anppd nunu^s, wa do not taiow, as yet, how many minutas m neaas- 
sary for ada^ate propass by avi^ga, below avaraga, or abova average 
studants. Thasa data m intandad to deseribe eurrant pr^tiaa; they ara not 
intandad to pmcribe teaching mathods, 

Tha first suggastion that foUows from these results is that taadian md 
adnunistrators gathar data on aaadamia enppd minutas in thair alais- 
rooms and eompara thdr resuits with tho^ obtdnad in tha WTBS study. If 
Aey wirfi to inareasa anppd minutas, tii^ mi^t use some of the sug- 
pstioi^ in this paper* Wa ara not sura, at this timej what methods isdU ba 
most suaaassfid mth dlffarant teadia^ and studants, and mudi ba 
pinad by aomparing rasults from different alassrooms, 

*nia following is a swnman^ of tha n^jor BTES flndinp on student 
anppment: 
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L llii nuniber of aaadimically engaged minutei ii modimtely hi^. 
The numbif of minutis studgnts spind actively engaged in aca* 
demio acti^ties is not as hi^ as one nu^t ardently wiih nor as 
low as some fewid. Typically, second-gmde students spend 
1 hour and 30 minutes and flfth-p^ade students spend 1 hour and 
55 minutes enppd in relevant academic activities in languagi 
arts and math eadi day (or about 40 percent of the in-class time), 
Tlie most efficient teachers (referred to as the "hi^ teachers" in 
this report) raise this to 1 hour and 55 minutes in the second 
grade and 2 hours and 30 minutes in the fifth grade (or about 50 
percent cf the in-class time)* Tliusj as compared with the average, 
students of the h!^ teachei^ are academiwlly enpged about 25 
minutes more per day in the second grade and about 35 minutes 
more in the fifth grade. If the high teacher are compared with 
the loWj dafly differences of an hour in engaged time appear* 

It is possible to interpret the differences between the hi^ and 
average teachers at least two ways. On one hand, in enppd 
minuteSj the difference between the average and the bast practice 
is no larger than 25 to 35 minutes per day. On the other handj 25 
minutes per day spread over ISO days equals 75 hours a year, and 
35 minutes a day comes to 105 hours! 

At present, it is impossible to say whether the average or high 
engaged minutes per day are adequate, particularly for 
low-achie^ng children. Wiat is impressive is that this is the first 
time such extensive data on engapd time have been available, and 
these data can sem as a baseline for subsequent studies in differ- 
ent schools and with different types of students. 

2* More allocated time does not lead to less engagement* Many edu- 
cators v/Qxty that if more time is allQcated to an activity, students 
will tire and the overall enpgement rate wfll decrease. The resuUs 
do not support this fear. In reading, there was a positive corre- 
lation between allocated time and CTipgement rate; in math the 
coitelations were about zero. (In each grade, the three teachers 
who were hi^est in total engaged minutes were also above 
average in both allocated time and engagement rate,) 

3* Seatwork and students working done is a dominant pattern, 
OveraU, students spent about 66 percent of their time doing seat- 
work during reading, and 75 percent of their time during math* 
Overall, students' enpgement rate was 84 percent in teacher-led 
poups, and about 70 i^rcent when doing seatwork. However, 
when a great deal of the allocated time is allottid to seatwork 
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(§.g., 90 pereent), thsn inpgsmint during sa atwork drops, espa- 
drily in miAemitios. Thtm was no e^dinoe that the seatwork 
acti\1tiei ware trivial; indf ed, the irror rate during seatwork was 
only di^tly lower than the error rate during teacher-led 
aotMties. At this timep the data have not been imdyzed to deter- 
nuni the optimal diitribution of seatwork and ^oupwork. 
4» Some nonenpged activities seem inevitable. Most teachers were 
fairly sinnlar in the amount of time spent on noninstructional 
acti^ties such as transitions before and after breaks, house- 
keeping tasks, and waiting between acti^ties* These activities 
took about 45 minutes per day. 

Even during time allocated for reading and math, interim 
activities (turning in and passing out papers, getting books, and 
waiting for help) (^cupied about 8 or 9 minutes in all classrooms* 
AU these activities may be necessary because of large classrooms 
and varied students. 

IHie teachers with the highest engaged minutes were able to 
reduce student off-task time (daydreaming, iocialiang) from the 
average of 8 niinutes per hour to 4 minutes per hour, but they 
were sinular to the average teachers in aU the above noninstruc-* 
tional and nonengaged activities. 

5. Substantive uiteraction is related to hi^er engagement. Sub- 
stantive interaction (i.e„ questions, answers, feedback, and ex- 
planations) during groupwork was correlated both with hi^er 
overall engagement and hi^er engagement during seatwork, sug- 
gesting that the practice and corrections during groupwork led to 
more enpgement during seatwork. Substantive interaction during 
seatwork was dso related to increased engagement during seat= 
work* It was not clear, however, whether this substantive inter- 
action came from a teacher majdng rounds or from aides in the 
classroom. 

6. -*Break time'~ is negatively correlated with student engagement* 
Break time referred to time spent in breaks-iecess, lunch, and 
m^lass breaks sudi as unscheduled physical education and leaving 
class to go to the bathroom, "niis time was negatively related to 
enpgement. It was su^ested in the BTBS report that ^latively 
long periods of "play" carry over and disrupt engagement during 
academic "work." 

7. It may be difflcult to And more time for academic instruction. 
Ih^m data pve the impression that a^demic time is more con- 
strained than we thou^t. If teachers wish to find more time for 
the academic instruction of low-achieving students, where is it to 
come from? The noninstructional time and the interim and ^It 
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timi during instruction appear to be fairly constant--ntcesdtatid 
by the difficulty of dgding with diverse ehildren and diverse 
acti^ties. Many edueatoi^ are riluctant to reduce the nonaca* 
demic time in musia and art. One alternative may be increasing 
the school day, another may be diminishing the non^ademlc 
activities for the less a^demlcally successful students* 

^though at present there is no e^ddence of ''diminishing returns'' from 
increadng^ allocated time and diminiAing breal^ (mdeed, quite the 
oj^odte), the BTES study ^d not examine the limits of increasing lo- 
cated time for different types of students. 

How Tbne I§ Anoeated In Etamenta^ Cla^rooms 

Let us begin with an overviaw of how time is allocated in elementary 
classrooms. Based on their ob^rvations, ^e BTES staff divided the daily 
classroom activities Into three major parti' 

• acmdertuc activities (readingj mathematics, science, and social 
studies); 

• "nonacademic'' activitiis (music, art, sto^time, faring); 

• noninitructlonal activities (transitionSj waiting between activities, 
class business). 

The amount and percentap of time allocated in each major category are 
presented in table 54 . 



Table 5 A . Tbne Allocations in Gtades 2 and 5 



Category 




Grads 2* 


Gmde J 




Tims 


Percent 


Time 


Percent 


Aeadamie Acthitiei 




57 




60 


Nonacsdemk 




24 


V 05** 


23 


Norunstmotional 


44** 


19 


45" 


17 



*The aversge time aUocited to each ^t^ofy wies a bit in the two pgdes 
because of the larpr numb^ of '*^Ut das^s** in the saniple of second pade 
da^ooms^ In the typkd ipUt cte^oomip one potip of students (e.^^ teeond- 
^de ftudents) att^ds ^hoo! froni 9:00 ^m. to 2:00 p,m, whUe the lecond 
poup attends from IQiOO ^nL to 3:00 p«m. Hiis ^litti^ doei not gppw to 
do any hsmi a number of the hi^est elayes in achievement pin were ^Ut 
dassniom^ However, this flitting U lomewhst itypl^ The rea&r may wish 
to foctis more on the descriptive statistics for the nfth ptdt, which represents 
the more ty^^ iityation-one where most stydenti attend school between 
9:00 a^nu and 3:00 p.m. or tiie equivalent (A angle table smnmaridni all 
theii data is presented in the appendix to this chapter^ together with the 
defmition of each catef on^,) 
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Hie pergentaps of timi in itch gradi ari quitt dinilar. Aaadimie and 
*^onacadin^'* aotivitiis oceupy the major portion of thi day* TTie lur- 
prisuig f^rt— but iu^iising only for thoie who are not elementary s^toI 
teaohin— is the larg€ amount of noninitmetional time, this nonlnitruc^ 
tionaL time^ whidi did not vafy muA from teacher to teaaher , appears to 
ripriiint a oonstant in classrooms as they art eurrintly oonstituted* 

Academic Activities 

In iaA pade, the larpst amoimt of time is located to acadimic 
activities, A typical sacond*grade student spends 2 hours and 15 minutes 
of ^ocatid time per day in acadsmic acti^ties, and a fifth-pade student 
^pands 2 hours and 50 minutis, (See table 5.2) 

Table § J , Allotted Time in Acadraic ActMttes 



Gfsde 2 Grade 5 





Minutei 


of day 


Minutfi 


Fircentagi 
of day 


Riiduig and luigtiage mU 


V 30'* 


38 


1' 50" 


39 


Mathematics 




16 


4S" 


16 


Other i^emla 


1" 


3 


17'* 


6 



The largest acti^ty is reading- A ^cond-gradc student spends about IH 
hours daily in readtag* mi a flfth-pade student spends 20 minutes more 
(1 hour and 50 minutes). 

Students spend less tfian hdf as much time In math as they do in 
reading md writing: 35 mtautis ta second pade and 45 minutes in fifth 
grade* Math aetivitias that occur during sdence and sodal studies ^e in- 
cluded in tWs flpre. Other academic activities, namely^ discu^on ^d 
manipulation in social studies mi science, occur for 8 nunutes a day in 
seCOTd gradi and 17 minutes a day in the fifth pade, Q^oi$ Aat when 
reading or math occurred during sodal studies or science^ ih$ acU^dty was 
coded as reading or math, not as other academic.) 

"Nonacadcmic" Activities 

Abtmi 25 percent of the in-dass time is devoted to *'nonacadenMc" 
subjects such as musiCs art, and physicd education, T^ese actl^dtles occupy 
an average of 55 ntoutei per day for second-pade students and 65 
minutes for flfth^de students, (Breakdown into separate categories 
were not avaflable.) 
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NoninstrucHonal Activities 

Almost 20 pireent of tha in-clais time is spent in noninstructional 
acti^ties (waiting after finishing an assipiments nonacademie class busi- 
ness^ and transitions between activities, including going to and from lunch 
and recess). These activities take about 45 minutes per day. Relatively 
little time is spent waiting between major activities (4 minutes per day) or 
in nonacademic dass business (6 minutes). TOe majority of this nonin- 
structional time (35 minutes) is spent in tmnsitions. 

Discussion 

At present wr do not know what amount of time is necessaiy for most 
students, partic jlarly less academically successful students. This experi- 
mental question is a high priority for future study. But if educators wish 
to increase the amount of time all students or specific students spend 
enpged in reading, math, music, art^ or science, where is this rime to come 
from? One could take time from one acri^ty and gve it to another, but 
these interest poups already daim "riieir" time is insufficient. Another 
alternative-diminiihing nonlnstructional time-appear to be difficult to 
implement beeau^ conducting a variety of acti^ties mth students who 
differ from each other in many ways takes a lot of instrucriond time. One 
alternative would be to help avemga teachers increase their allocated time 
and enpged time to that of the highest teachers in this sample. Yet we do 
not know if even that much time vdll be sufficient for the lower achieving 
students. Another altemarive, particularly for meeting the needs of the 
lowest achieving students, would be to increase the length of the school 
day, 

Acadeniic Engaged Minute per Day 

^e major interest, however^ is not allocated time but the minutes a 
student spends directly enpged in reading, math, and language arts. TTie 
BTES reiearchers called this rime "engaged minutes'' or **academic en- 
gagid minutes/ * "Diere were two major fmdinp in the BTES study: 

1. The avemge daUy academic engaged minutes is about 1 hour 30 
minutes in second grade, and 1 hour 55 minutes in the fifth 
pade. In each case this is about 40 percent of the in-class time. 
The high teachers were about 30 minutes above this figure; the 
low teachers were about 30 minutes below* 

2, The hi^ teachers in each grade not only aUocated more time, but 
their classes also had a higher $ngagement rate tPmn average 
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teachem Thm, withm tiie limits of this study^ allocating more 
time in academici did not lead to diminishing returns, 

In coding academic engaged minutes, the BTES observers watched six 
students in eadi class throughout the day and coded a student as enpged 
in raadinii math, or language arts when he or she was directly engapd in 
these actiwties. Engaged students mi^t be attending to a teacher in a 
group, reading a book alone, writing a composition, or doing seatwork in 
readmg or math* As we shall see in the next section, there were three types 
of nonenpged activities^ interim activities (diarpening pencils, turning in 
and passing out papers, getting books); waiting for hdp from a teacher or 
waiting for a paper to be gimded; and off-task activities (socializing, day- 
dreaming, misbeha\dng)* Thus, when students were putting their names on 
worksheets, or were waiting quietly for papers to be graded, they were not 
coded as enpged. 

Table 5.3 presents information on the average allocated time, engaged 
minutes, and engagement rate for the three teacher in each grade who 
obtained the hi^est total engapd minutes, for dl the teachers, and for 
the three "lowest" teachers. (There were some teachers who had sli^tiy 
higher engaged minutes in reading alone or mathematics alone, but the 
hi^ teachers in this table were for reading and mathematics combined.) 

We do not know how representative thesf teachers are of all teachers. It 
is tempting to assume that the high teachers in these samples represent the 
best in current practice, but there may be other teachers who are even 
more effective in obtaining engapd minutes. Since this question cannot be 
answered until additional studies are conducted, we will assume that the 
high teachers in tiiese samples are in the upper 10 percent of current 
practice, recoiling, of course, this assumption may be changed as future 
results are accumulated. 

Engaged Minutes in Second Grade 

As table S3 indicates, the average students in the second grade were 
enpged in reading acti^ties for an average of 1 hour and 04 minutes per 
day and enppd in math for 26 minutes, for a totd of 1 hour and 30 
minutes of academic enpged time per day. "Hie students in the classrooms 
of the three hi^est teachers were engaged about 20 minutes more in 
reading, about 4 minutes more in math, and about 25 minutes more over* 
all. "nie hi^ teachers obtained this extra 25 minutes in two ways: their 
allocated time was hi^er, and their engagement rate was W^er (81 per- 
cent compared with 72 percent for average teachers). 

TTie difference in engaged minutes between the average and the hi^ 
teachert is 25 minutes per day. If this is spread out over 180 days, it comes 
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TMe S3 H^^, Av^^, and Low^t Tmhers in A^donfc En^ed Minute 







Reading 






MathenmtiQs 




Total 






Engige» 






Enpga- 












rite 


Enpged 
minutes 


ment 


Engaged 
minutei 


Allocate 


Engage 
minutes 












Sscond grsde 








Hi^3 


1*45** 


81% 


1*25** 


35*' 


Bm 


30" 


2* 20" 


1*55*' 


Average 


r 30'' 


73% 


r 04** 




71% 


26** 


2' 06" 


1* 30" 


Low 3 


r 00** 


72% 


43** 


30" 


75% 
Ftfth ffadm 


22*' 


1*30** 


1' 05'* 


H^3 


2' lO*' 


80% 


1* 45'* 


S3'* 


86% 


45" 


3* 03** 


2' 30" 


Averip 


I'SO" 


74% 


1'20** 


44** 


74% 


35" 


2' 25" 


1* 55" 


Low 3 


r 25" 


€3% 


1' 05" 


31'* 


63% 


22*' 


2* 03** 


V 25" 
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to 75 hours! It would seim important to condUGt experimental studies to 
help avaragi and low teacheri raisa their engaged minutes and to determine 
the effect of this riie on student achievement. But the figure of 1 hour and 
55 irunutes of engaged time per day may be the upper bound for the most 
efficient teachers in currently constructed second-grade classrooms. At the 
same time, it does not appear that students in seeond pade are being 
overburdened by large amounts of engaged time in reading and math. 

Engaged Minutes in Fifth Grade 

Tlie pattern in fifth grade is similar to second grade except that all 
times are larger because of the longer school day. There were no split 
elates in the fifth grade as there were in ^cond grade, and there were 
fewer breaks. 

As is shown in table 5.3, the average students in the fifth grade were 
engaged in reading activities for 1 hour and 20 minutes per day and en- 
pged in math for 35 minutes, for a total of 1 hour and 55 minutes of 
academic engaged time per day. The students in the classroom of the three 
iUghest teachers ware engaged about 25 minutes more in reading and 10 
minutes more in math, for a total of 2 hours and 30 minutes of academic 
enpged time per day. As in the second pade, the hi^ teachers achieved 
this extra 35 minutes of enpged time in two ways: their allocated time 
was hi^er and their engagement rate was higher (83 percent to 74 
percent). 

Again, this figure of 2 hours and 30 minutes per day for the high 
teachers (or about 53 percent of the in-class time) may represent the 
current upward limit for engaged time in reading and mathematics 
activities. If the 35-minute difference between the hi^ and average 
teachers is multiplied by 180 days, it comes to 105 hours. Apin, we do 
not know how much engaged time is sufficient for different children, 
particularly for low-aehie^ng children. 



Summary of Academic Engaged Mintites 

Because it is difficult to remember aU the numbers in the preceding 
sections, a siinplified summary is presented in table 54. 

A major problem hi interpreting these results is that we do not Imow 
how much time below average, average, or above average students need to 
make reasonable progress in reading and matii. It may be that for low- 
achieving children 2 hours per day of engaged time is not adequate. Nor do 
we know whether we can use the actual engaged time more efficiently, 
Hiese areas are hi^ priority for future research. 
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Table 5.4. Daily Enpged Minutes in Raading md Math 







Grade 2 






Grades 






Total 

engaged 
minutes 


nient 
rate 


Percent 

of 
in'Class 
time 


Total 
engaged 
minutes 


ment 
rate 


Percent 

of 
in'Class 
timg 






82% 


50% 


T 30" 


82% 


53% 


Average 


r 30" 


71% 


39% 


rss" 


79% 


40% 


Law 3 


r OS" 


72% 


28% 


r 20" 


69% 


28% 



OnQ interpritation of the data in this saction is that the average amount 
of academic enpged time per day is not particularly high. A fuUy engaged 
student could complete his daily reading and mathematics in 1-^ hours in 
second grade and 2 hours in fifth grade. Or, it could be said that students 
attend to reading and math activities for about 40 percent of a school day. 

The three teachers with the hi^est number of enpged minutes are 25 
minutes above the avemge in second gmde and 35 minutes above the 
average in fifth grade. If these daily differences are aggregated across a 
school year, the differences are quite high; but we need experimental 
studies to detennine the effect of hoping average and low teachers raise 
their engaged minutes per day. At the same tlmCp these highest teachei^ 
may be ^ving us the natural boundaries of the best of current practice. 
Additional studies could determine whether teachere across the country 
are equaling or exceeding the^ levels. 

Does More Allocated Time Lead to Less Engagement? 

As we see in the tables abovep the enpgement rates of the three hi^ 
teachers— in both ^ades and in both subjects— were higher than the engage- 
ment rates of the other teachers* (Acro^ the entire sample, the corrda- 
tions between allocated time and enpgement rate were about ,23 for 
reading and about -.10 for math.) Further, students of the high teachers 
spent less time in clearly off-task behaviors such as daydreaming or 
socializing. Hiusp 2 houn of engaged time in the second pade and 2 hours 
and 30 minutes in the fifth grade did not lead to bored and restless 
students. 

What Were Students Doing When They Were Not Engaged? 

During the allocated time for reading and math, what were students 
doing when they were not enpged? TTie BTES study coded three types of 
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noniiipgid activities during aUoGatsd tinii.* interim activities (sharpfning 
l^ncUs, tuming in and pacing out pa^rs, getting books); waiting for help 
from a teacher or waiting for a paper to be paded; and off4^k activitlei 
(sodilizmgi daydreaming, miibehaving). Table 53 pves information on 
how students spent their nonengaged time* For conveniencij these are 
presented as minutes per hour. 

LooMng at the averapt students were not engaged 16 to 17 minutes of 
each hour ^located to academic activities; con verselyj they were gainfidly 
engaged 44 minutes of each hour (or 71 to 73 percent of the time). 

Interim and Wait Activities. LooWng at table 5 ,5, we see that for almost 
all teadiers, 7 to 9 minutes per hour of nonenpged time spent on interim 
acti^ties and waiting appears to be a fact of current classroom life that 
applies to even the most efficient of classrooms. (The correlations between 
wait time and enpged minutes or interim time and enpged minutes were 
quite low, a^^rapng only -.1001^ most second- and flfth^grade classrooms, 
it takes time to pass out md collect books and papers, and students have 
to wait for help, corrections, and instructions. Under the most efficient 
conditions these activities take 7 minutes per hour; under the least efflci- 
ent conditions^ they take 10 minutei an hour. There is little variation 
across classroomsp 

Ihe major difference among teadiers is in the amount of student off- 
task behavior In average cla^rooms, this occupies about 8 minutes each 
hour* The most efflcient teadiei^ reduce this by half, to about 4 minutis. 

Comittsian. Nonengapd time seems inevitable. In average classrooms, 
students are not enpged about 16 minutes per hour of allocated time in 
rea^ng and math; the three hi^ teachers reduce this mount to 12 
minutes per houn In cla^rooms of both average and high teadiers, 
students spend 8 to 9 minutes in interim and wait time. Thus, the differ- 
ence between the teachers who had the hi^est academic engaged minutes 
md the average teacher was about 4 minutes of nonenpged minutes per 
hourj and most of this difference occurred because the hi^ teacheii re- 
duced off-task time to about 4 minutes per hour. (Remember, howevir, 
that the high teachers also had more allocated time,) 



Tima With thi Ttacher and Tune in Siitwork 

What major activities occur during the allocated time? *nie BTES study 
pthered data on the amount of time a student spent in a teacher-led (or 
adultJed) poup and the amount of time a student spent in seatwork (table 
5.6)* OveraB^ students spent about 30 percent of their time in a teadier-led 
setting and 70 percent of their time doing seatwork. Thfa hea\^ amount of 
time in seatwork occui^ because tea^e^ frequently di^de a dass into 
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Table 5*$. Nontti^ed Tone During Re^mg and MaA in Minute per Hour 



Reatog Mithtmatics 

Interim md IntgriRi and 
wait ttoie Off'taik Total ^t timi Off-task Total 



Second pttde 

High 3 9*' 3" 12" 20% 7** 4" IP 18% 

Average 9" 7" 16" 27% 9" 8" 17'* 29% 

Low 3 S" 9" 17" 28% 7" 8" 15" 25% 

ftfth grsde 

Hl^ 3 7" S" 12" 20% 3" 5'' 8" 14% 

Averiii 8" 8" 16" 26% 7" 8" II" 25% 

Low 3 9" 13" 22" 37% S" 14" 22" 37% 
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Table 5.6. Tmm Spent in Twher<Led Settmp and in Saatwork 



Grade 
and 
subjact 


Setting 


Parcenl 

of 
tinia in 
^tting 


ment 
rata 


2 reading 


Teacher»led 


36 


84% 




Seat work 


63 


68% 


2 mitheniEtici 


Teacher-lad 


27 


82% 




SiatWQfk 


73 


67% 


S rcEding 


TeacheMad 


31 


84% 




Seat work 


70 


7m 


5 mathemstici 


TaachaHad 


24 


85% 




S^twork 


76 


72% 



three or more groupSi and if there are three groups in a classy a student can 
only spend one-third of the allocated time in a teacher-led setting. 

As is iho^ in table 5.6, when students were in teadier-led groups their 
enpgement rate was about 84 parcenti whereas during seat work it was 
about 70 percent. Although engagement during seatwork was di^tly 
higher in the fifth grade than in second pade-suggesting that older 
students are slightly better able to work alone-die discrepancy between 
enpgement during teacher Jed activities and during seatwork is still large. 
Thus, although students spend most of their time in seatwork, their 
enppment rate is lowest in that Mtting. 

TTiese figures illustrate the difficulty teachers have in working with 
students of different achievement levels. Students- engagement rates are 
about IS percent hi^er when they are in groups supervised by the 
teacher^ but if the teacher only worked with the class as a whole, the lower 
achieving students would be behind and the hi^er achieving students 
mi^t be bored. 

Other studies (StaUinp and Kaskovdtz, 1975; StaUinpi 1977; Soar, 
1973) liave also found that students are more enpged when th^ are 
instructed or supervised by a teadier thai when they are working alone. 
Further, the Strings and the Soar studies have found that teacher time 
^ent working with groups of students is positively and consistently re- 
lated to achievement gain^ whereas teacher time spent working with one or 
two students is consistently negatively related to student gain in achieve- 
ment, ^ese neptive results probably occur because, when a teacher is 
working with only one or two students, the remaining students have to 
work independently. As we have seen, independent work has lower enpge- 
ment rate. 
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Currently^ the nmd for students to spend 60 to 75 percent of their time 
working alonf is a fact of classroom life. Whether this percentage can be 
reduced, or whether instruction can be organized so students are more 
engaged when working alone, are major areas for future research. 

Are Seatwork Activitm Trivial? 

nie term "seatwork'' frequently connotfii trivial activities^studints 
coloring the figures in a stoo^* working on taiks far below their level of 
achievement, doing busywork. From two perspectives* the BTES research 
suggests that this nagative picture is not true. 

In the BTES study, the specific content of material the students were 
working on was coded. A special category was created to code material or 
activities which wer ; ''below the level of the test*' used in the study. Only 
6 percent of the ' w was material coded as below the level of the test, 
suggesting that riiviinlngless bu^work is a relatively rare event. (The 
standard deviations were also smaUO 

Another way the BTES study looked at seatwork was by coding the 
error rate of students during seatwork. It mi^t be expected that the error 
rate during seatwork would be lower than the error rate during teaeherJed 
activities; that is, most teachers mi^t place students at their "inde- 
pendent" level during seatwork and their '"instructional" level during 
groupwork. In second-gfade reading and in fifth-grade math* the error rate 
was the same in teacherJed settings and in seatwork; in second-grade math 
and in fifth-grade reading* the error rate was only sli^tly lower in seat- 
work settLngs. Overall^ there was no evidence that the seatwork was 
particidarly easier than work in teacher4ed groups. 

TTius, althou^ the allocation of a hi^ percentage of time to seatwork 
is a necessity in current classrooms, the results suggest that seatwork activ- 
ities are an integral and contributing part of classroom instruction, rather 
than trivial busywork. 

Influendng Engagement During Seatwork 

The nature of hetirogeneous classrooms and current instruction re* 
quires that students spend a large amount of time worldng alone at seat- 
work. Yet* as was shown in this study and in many others, students are less 
engaged when they are doing seatwork than when they are worldng with a 
teachen At least three suggestions for increasing engagement during seat- 
work emerged from this study: 

1. Increase substantive interaction during groupwork, 

2. Increase substantive interaction during seatwork. 

3. Keep seatwork time as low as possible. 
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Substantive Interaction During Groupwork 

Givan the hi^ir engagement during groupwork, it is not surprising that 
the imount of time students spent in ^oupwork had a correlation of .31 
with their oviraD enpgement. But the subitantive interaction which took 
plaee— explanadons, quastions and answers^ and faedback— A^ms an even 
itronger predictor of overdl engagements yielding a correlation of .45. In 
other words, dthou^ having students In teadier4ed groups is positively 
related to student enpgement, it is even better to use this group time for 
asking questions and pving feedback. 

Otiier studies have shown Uiat the fraquent use of short, factual ques- 
tions is poatively correlated with gain in achievement, whereas other types 
of questions are often uncorrelated or negatively correlated ^dth gain in 
achievement It is thus luggerted that explanation, asking frequent, short, 
factual questions, and pving feedback to the type of substantive inter- 
action which is related to ovemU enpgement. 

The mommtum of mbstantiv^ interaction. Substantive interaction 
during ^oupwork not only is correlated with hi^er engagement during 
teacher-led activities, but it is abo positively correlated with student en- 
pgement during seatwork, particularly in reading. TTie BTES author sug- 
gest that imng most of the time during poup lessons for substantive 
interactions creates a sense of purpo^fulness, and students then apply this 
s«ne momentum and ifficlency to their seatwork. 

Other studies (Rosenshine, 197S) have found tlmt teadiers with a 
strong academic focus in their claMroom had students with hi^er gdn in 
achievement* An emphasis on substantive interactions during poupwork 
may be another fllustration of a strong academic focus. 

Substantive Interaction During Smtwork 

The data on second- and fifth-grade reading and math can be thou^t of 
as falling into four quadrants. In three of the four quadrants, the amount 
of substantive uiteraction a student received during seatwork was posi- 
tively (althou^ moderately) related to student enppment during seat- 
work. Tlie BTES report presents one dramatic iUustration of Ais flndlng. 
In second-pade math, the researches divided classes that had over 70 
percent seatwork into two grou^* one group had substantive interaction 
during 1 1 percent or more of the seatwork time, and the other group had 
substantive interiction about 5 percent of the seatwork time. (Note that 
even "hi^'* amoimts of substMitive intemctlon durmg seatwork are rela- 
tively rmall.) The enpgement rate in the hi^ interaction classes averaged 
71 percent J whereas the enpgement rate in the low interaction classes 
averaged 61 percent. 
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Unfortunatily, the current analyses of the data did not answer a 
number of questions about seatworkj althou^ these questions will be 
explored in the forthcoming secondary analyses of the data, Thus^ we do 
not know the optimum proportions of seatwork and groupwork. The 
amount of time in seatwork may be dependent on the number of instruc- 
tional groups a teacher has. In this study^ the minimum amount of time 
spent in seatwork was about 35 percent of allocated time. This 35 percent 
might be seen as the natural lower limit, although we do not know if it is 
the optimal percentsge. 

Decreasing Time in Seatwork 

TTie BTES resiUts sug|est that in mathematics, increased time in seat- 
work tends to be neptively associated ^th engagement. ITiat a dass 
with 90 percent allocated tima in seatwork fiequently has a lower eniage- 
ment rate than a mathematics class with 60 percent ^located time in 
seatwork. IMs may occur because seatwork m mathematics frequently 
condsts of doing a large number of computational problems without 
immediate feedback^ and the longer this goes on the more restless students 
(and adults) become. 

Overall, substantive interaction during group work and during seatwork 
is related to hi^er engagement during seatwork, and in mathematics in- 
creased allocated time to seatwork is associated with diminishing returns. 
One cautioHi however; these are eorrelational results and need to be repli' 
cated in experimental studies. 

How Do Breaks and Transitions Affect Engagement? 

We have sometimes thought that if students had more breaks, they 
would be more engaged the rest of the time, ajid enpged minutes would 
increase. Unfortunately, the current correlational data do not support this 
argument. 

One of the catcgoriess *'wait timej" refers to time between instructional 
activities; it can also include time when a teacher is working with a few 
students and the others have finished one activity and are waiting for a 
new acti^ty to begin. Althou^ student wait time averapd only about 4 
minutes a day, in the second grade, wait time was negatively correlated 
with student engagement rate in both reading and math* ITie neptive 
correlations suggest that for second-grade students such waits do not con- 
stitute a refreshing break, and that the distraction which occurs during a 
wait transfers to less engagement during subsequent reading and math 
periods. "Diese negative correlations did not occur for the older, fifth-grade 
students. 
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"Break tifiif" was naptively corrilated ^th snpgement in both 
itcond and fifth ^das. Brtaki inciude ricass, lunch, and in^lass breaki 
such is unichedi^ed phyM^ iducation md lea^g d^m to use the rest^ 
room, BTES itaff behevei that this suggests thit relatively long and/Qr 
frequent bre ato may establlA a pattern of itudent '"play** that carriei over 
into periods of i^demic *'workj** resulting in lower rates of work enpge- 
ment. Thii finding seems dmflar to the pre\dous one on substantive inter- 
.^tion^ tiiose teachers who emphaazed an atmosphere of work obtained 
more student enpgement during aUocated academic time than those who 
were concerned that students ha^ enou^ **play*" Of coune, this does not 
suggest that effective classrooms were hardhearted sweatshops. Quite the 
contrary— even in tiie classrooms ^th tiie hi^est engaged minutes, 
students were enpged in reading and math activities no more thin 50 
percent of the in=class time. 



SummaTy 

L Time allocations. About 58 percent of the school day is ^located 
to acadenuc activitiiSs about 23 percent to nonacademic activities 
(e.^, mimCf art, physical education), md about 19 percent to 
nonmstructiond activities such as trandtions between activities 
and class budness. 

2. Enppd time. On the average , students spent 1 hour and 30 
minutes (second grade) aid 1 hour and 55 ittoutes (fifth pade) 
actively enpged in reading and math activities. In the hi^est 
classrooms the enpged time wm about 30 minutei longer, and In 
the lowest classrooms it was about 30 minutes le^ than the aver- 
age, 

3. ^ the aveimge, ^udents were engaged about 73 percent of the 
aUocated time in reading and nmth. Teachers ^th the W^est 
located time dio had the bluest enppment rates (about 82 
percent), Tsim, mMn the limts of tius studys tacreasing allo- 
cated time did not lead to diminidiing returns; quite the oppodte, 
teachers who had more aUocated time d%o had hl^er engagement 
rates. 

4. During located time for academic, students were not enppd 
about 16 minutes an hour* on the average. Half of this non- 
enppd time i^s t^en up vdth interim activities (e.g.s passing 
out and coflecting papeim) or waithig for help* and the other 8 
minutes were when students were clearly off task. Clasarooms 
were fairly Mmflar in interim and wait time, whereas the most 
efficient teachera reduced off-task time to 4 minute per hour. 
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5. &atwork. ^eraU, students spant about tw^thirds of the alio- 
catid academic time in leatwork (or »lf'paced activities) and 
about oni-third of their tune wgrldng ^th an adult. Engagement 

hifii&t hi teaeher-iid ^ttinp (about 84 per^nt) than in saat- 
work settinp (about 70 percent). An Ine^table fact of classroom 
life is that if a tiacher worldng alone divides a class into three 
poupSj students will be working alone two^thirds of the time. 

6. Tliere was no evidence that seatwork acti^ties were trivial. Seat- 
work acti^ties were coded as **below the level of the test" only 
mbout 6 percent of the time. 

7. Increasng enpgement during seatwork. ITie amount of time 
teadie^ spent in substantive interaction— explanation, questions, 
student answers, and teacher feedback— w^ poatively correlated 
wi^ engagement during teadier4ed acti^ties. In addition, sub* 
stantive interacdon during poupwork was podtively correlated 
vnth enpgement during seatwork, su^eiting that tids substantive 
interaction creates a sense of purposafulness that students then 
apply to their seatwork. 

8. Student engagement during seatwork mcreased when there was 
substantive mteraction between teadier and student during seat^ 
work. Such substantive interaction consisted of a teaAer (or 
aide) monitoring seatwork and holding students accountable by 
asWng questions. Such substantivf interaction was most effective 
when it occurred 1 1 percent or more of the seatwork time. 

9. Break time. Break time (n^ss, lunch, in-cla^ breaks, leanng class 
to use the restroom) was neptively correlated vdth enpgement 
in both second and fifth gmdes. "nils suggests that teadiers ^o 
emphaazed an atmosphere of work obtained higher enpgement 
than teadiers who were concerned that students have enough 
*'play/' 
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Appendix S J> Averse Allocated Time per Day in Pitferent Activitfes 







Grade 2 




Grade J 






Minutes 


Combined Combined 


Minutes 


Combined 


Combined 


Time ^tegory 


per day 


minutes percentage 


^r day 


minutes 


percentage 


Actdemic activities 




V 12" 57% 


rso** 


2' 51" 


60% 


Reading and language arts 


r 28'* 




1*50" 






Mathematics 


36" 




44" 






Other a^denuQ 


8" 




47** 






Nonac^demie aetivitiei 




55" 24% 


1*05" 


1* 05" 


23% 


Noninstruationd activities 




44" 19% 




47" 


17% 


Tianiition 


34" 




34H 






Wait 


4" 




4" 






Housekeeping 


6" 




r 






Major tn^clasi time 


rsr 


3' 51" 


4* 44" 


4* 44" 




Lunch, recess, breaks 


V w 


r 15*' 


1*17" 


1* 17" 




Length of sdiool day 


r 06** 


5* 06" 


6* 00" 


6* 00" 
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Appendix f J. Geniral Time Catagomi 



Reading and iMn^wge Arts 

Reading and langu^ arts refers to ^ time illocated to readnig and languafe »ti 
my time durii^ day, fneluding reading and lan|uage arts activities in sden^, 
^oal studies, art, and muMe« 

Mathtmsties lefen to ^ mathematioi activitiei during the day, m all subjeot 
areaiL 

Oth§r Acadermc 

Oth^ a^demic instruction refers to acmdemic initeuction other than reading and 
mathematfcs. This includti sadal studio and science (where there b no reading or 
mathema^s content)^ 

Nonacademic histaction Mdudes muiic, art, iMstured physical education, flag 
salutas^ sharing, and storytime^ 



Wait refers to periods of no activity or no moveintnt between aeti^ties. This 
woidd ocmsr whin a tfudent finishes his/her work eady at^ no other ictinty ii 
Initiate However, waiting for help during reading or mathematici is counted as tmie 
in r^dhig Of mathemati^ 



Tmnrition refm to periods of change from one activity to anottier. Thy ineiudei 
Unhig up» tiddng saats^ or quteting down tefore the next activity. However, tinie 
spent pairing out reading or mathemattes materiali is counted as time in readini or 
nuthamatki. 

Qass Su^ne^ 

dass businass rafars to conduct of nona^demic class buaness such as distribution 
of notl^i, eoQaction of mUk money, or maldng anangements for a ^Id trip* 



Btmk tncludas my racraational or free periodL It primarUy refers to lunch and 
recess braaki, but tl^ includas mflk breaks, unstructured physic education, md 
living class to use the rasteoom^ 



Wait 



Tmmition 



Steak 
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On Learning To Teach 
Effectiveiy From Research on 
Teacher Effectiveness 

Gary D, Femtermacher 



Like the child who asks whgre the snow goas aftgr it meltS; some may 
wonder where educitional research goas after it is flniihed. TTiirty years 
ago it went into conff ranee papersj academic joumdi, monographs, and 
coUega textbooks. It stiU goes there. It also now goes el^wherei to places 
^th such names as J^velopment, Dissemination, Diffusion, Utiiizationj 
md Change. Completed research is sent to these new places presumably to 
gain an audience which cannot be counted among the primary readenhlp 
for scholarly and technical publications. Does this search for a different 
audience mean that development^ dissemination, diffusion, utUization, and 
change are activities devised merely to share research with those not likely 
to encounter it in the normal course of events? 

I think that "no" is the correct answer to this question, Developmentj 
dissemination^ etc. are fonnali sponsored activities, desired to achieve 
more than the ^ple imparting of information* Hieir intended results are 
describad in such phmses as having an imp^ti chanpng existing practice, 
creating and maintaining innovation, and making propess. It is under- 
standable that researchers and ^eir patrons^ wi^ to see practitioners 
advantaged by the fruits of scientific inquiry. Wiat is not obvious Is how 
the nonresearch audience Is, in fact, advantaged by development, dissemi^ 
nation, and aQied acdvities. 

Hiis chapter deals with the question of how a teacher mi^t be consid- 
ered advant^ed by formal activities intended to link research on teacher 
iffectiveness with effective teaching. There are many ways to bufld bridps 



ll^e notion that res§areh€rs havs pg^oni ii taken from Denham (1978). 
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bitwiin risearch on teaching and teachir practiceis but only three will be 
discussed here, Th^y are: (1) rules, (2) ewdence, and (3) schemata. As the 
discussion unfoldii it wfll become obvious that, were I a bridge inspector, I 
would condemn bridgis built with riJiSj certify bridges built with evi- 
dince, and commend bridges built with schemata. 

To mak© the text a bit eaaer to read, I diaU use the term "bridpng" as 
a stand-in for the mora cumbersome "developmint, dissemination^ diffu- 
sion, utilization^ and ch^gep'' DeveloperSj disseminators, chwge agents^ 
and othe^ may reel in hoffor at this simpliflcation of their life's work and 
do so with some Jusriflcation* These activities are reasonably discrete^ and 
hance I treat them somewhat unfairly by squashing them into a single 
lump* But what remains to be said in tiiis chapter does not demand so fine 
a differentiation as has become tiie custom* Bridging, for our purposes, is 
what one does whan brin^g completed or near-completed educational 
research to bear on educational practice— be this practice that of policy- 
makings decisionmaldng, or classroom beha^or. The question that guides 
this inquiry is how bridpng may take place so that practitioners are most 
advantapd by the outcomes of research on teaching. Tlie Beginning 
Teacher Evaluation Study ^ be used l^rou^out to Ulustrate and provide 
examples for the points to be made. 



Brid^ng With Rulas 

Rules may serve as the means for brid^g educational research and 
practice. This happens when the results of research are converted to im- 
peratives for teachers to foBow. For example, mong the findings of Phase 
III of the BTES is that "more substantive interaction between the student 
and an instnictor is associated with hi^er percentages of student engage- 
ment" (Fisher at al., 1978, pp. 1M4). Loosely restated in the larger 
context of the BTES, this finding stipulates that a student is more likely to 
show a g^ in achievement of a basic sldll if tiie teacher maintains a 
reasonably high level of academicaUy relevant interaction mth that stu- 
dent. A parson enpged in bridpng could use this finding as a r^e to 
govern teacher practice, A principal, for exmple, nii^t ask the school 
staff to devote not less than half the time available in a pven instructional 
period to teacher4ed small poup instruction (and do so in the probably 
correct belief that teacher-led smaU group instruction is a good way to 
enhance engagement, but in the questionable belief that half the students 
in a class constitutes a smaU group). In taldng this action with the staff, 
tiKe principal is bridpng research and practice by converting a flnding to a 
nile and requesting compliance with the rule. 
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In our modifn systim of ^hooUng, one need not act vary forthri^tly 
to be engaged in rule bridpng* A tople request by one in authority can be 
viewed as a command when directed to a person of le^ authority* An offer 
of support contingent upon taldng certain steps can have the force of i 
ripdly applied rule. A veiled suggestion that doing x ^iU be a factor in 
another's evaluation can turn the doing of x into a most demanding re^ 
quirement. In each case there is an ex^ctation that one \dll modify his or 
her behavior according to mother's intej^retation of a research finding. In 
nde brid^g, the recipient of the command is not asked to pondar or 
condder tha research flnd^g itself but rather is askad to behave in ways 
that take account of the rule formed from the flnding. 

Bridging r^es brings little if any advantage to practitioners. Some 
of the reasons why this is so must await further development of the 
argument. A few of the reasons are accessible now. In general^ rules are 
based exclusively on the flndinp of reseamhi and not on the research 
program con^dered as a whola. There are several faults in an exdusive 
reliance on flndinp. The Umt is the great potandal for misinte^ratation of 
the findings. Research findings read out of the context of the entire re- 
search effort may be very misleading^ miou^ researches make caraftil 
attempts to dalimit their flndinp, there is simply no practical way to 
attach all the exclusions^ exceptions, and ''other thinp being equd'" to 
each and every finding, A raading of tha chap tan in this books for exun^ 
pleg reveals many different interpretations of the same flndinp of the 
BTBS^ Second, tha flndinp themselves may be unworthy of great confi- 
dence, as would be the case if they were not hi^y confirmed by the data, 
or if they were artifacts of tha way the data w&m andyzedj or if they were 
based on an inadequate or unrepresentative sample. TUrd, whan flndinp 
are convarted to rules dia effect Is to generalize the flndinp to everyone 
subject to the rule. In many instances, tha research simply wfll not support 
such pervasive and uncritical generalization of flndinp. Finally, the nde 
may be an inv^d interpratation of the fmdingj as would occur if it ware 
AowHi in the example abovcj that teacher4ed, small poup instruction did 
not enhmice a student's engagament in a task. 

Periiaps the most dabUitating aspect of bridpng with ndes is its effect 
on tiie practitioner*s percaption of his or her stature and competence. 
Persons axpactad to change tiieir behavior on the basis of rules imposed by 
others m denied a portion of their freedom to think and act indepen- 
dently. Carta^fy we must dl tolarate a depee of imposition in order to 
fare waU in life. Howevar, if practitionars are to have Ae opportunity to 
pow as profasMonalSj oAer meam of brid^g researA ^th practice may 
be far more productive of profession^sm than tfie use of ndes. Dewey 
(1929) recopiized the temptation to bridge with rules and cautioned that 
**no conclusion of sciantiflc research can be convartad into m immediate 
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nUe of educational art*' (p. 19), I biliive that Dawey maant that no find- 
ing ^ould be convartad to an immediate rule, for certainly it can be dona 
and ill in fact, done regtdarly« 

Brid^g With Evidence 

Bridging with a^ddance occurs when the results of rasearch are used to 
test tha belif fs that practitlonars hold about their work* A faw axamplei 
may prove htlpfid, Mr. Smithg a mamber of a local school boardj arguas 
that too much monay is spent on aduoationp He adds, *Taachaii make 
almost no difference whatsoever in pupil achiavament; it's aU a matter of 
home background and aptitude," Ona concludon of Hiasa II of the BTES 
is that '-teaching performances make a substantia contribution to what 
children learn" (McDondd and EUaSj 1976, p, 54), TTiis eoncluiion serves 
as a^dance to test tha soundness of Smith *s baUaf, Preianted to him, along 
with othar evidence, it may larva ai the occasion for chan^ng his mindp 

Another axmnple is the case of the teacher who argues that it Is par-^ 
fectly all ri^t for students to maka nMstakes; "After dl, how can you 
learn if you don*t make nwstakas?" Th§ teacher who believes this may ba 
quite offhand about prapaiing assignments for students, tWnldng that they 
can always ask quastions if ^ey are confused. A finding from Fhisa III 
states that "tasks which produce low error rates prowde situations where 
students can rapidly improve thair perfonnance and continue to learn as 
tasks with maU incraasas in difflc^fy ara ancountered'' (Fishar at d*, 
1978, pp* 2*6)* Tliis fin tog casts doubt on tha adaquacy of the teacher's 
belief about the acceptabUity of mlstakas. It tmy not always be possiblei 
or advisabia, to provide effor-fraa tasks, but tha finding suggests that the 
teacher diould be mora carefid in davaloping and assi^ing laaming tasks. 

In these two axamples, the results of research ara baing used to cdl into 
question tiie objective raasonableness^ of practitioner baliafs. However, 
research can also be u^d to substantiite teacher beliefs. Ms. Rodriguez, a 
fifth-grade teacher, may baUeve that the constant Interruptions in her 
classroom caused by public addra^ announcements, wito^i puU-out pro- 
grams, and a schedule that takes the class from the room three times a day 
is having an adverse effect on student learning, *nie Hiase III flndinp, 
eoniidered in their entirety, lend support to Ms* Rodriguez' belief . Inter- 
ruptions of a class do affect a teacher's ability to maintain enhanced rates 
of student enpgament in academicaUy relevant tasks. (Th& preceding 



^Itif obJeQtive fM^nableniis of beUef is djsausssd In detail by Gmn (1971). A 
disQUsdon of reasonable baUaf in rektlon to reitardi on teadiini is Qontiined in 
Finitermadier (1979), 
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ghaptir by Rosenahine providis g ditailad aoaount of how school acttvitiis 
afftet angapment rates,) In thfe axampte, riSfarQh flndinp providi evi- 
detici in su^ort of a btUif that may have been based solely on peiional 
experianae. 

Bridging with e^denQi does not require a practitioner to modify beliefs 
every time researeh flndinp are proffered. It requires only that the praeti^ 
tioner weigh serioudy the ^lulti of the research. To require more would 
be to plaae peater eonfldenee in research on teadiing than it may lepti^ 
mately eonunand. Where risearch findings conflict with beliefs for which 
diere are other reasonable pounds^ tiie practitioner may be Justified in 
choosing to adapt or ignore the conflicting fln^np. Hie BTES error rate 
flnding offirs an opportuiUty to explo^ this point. 

"Hie BTES reseaich te^ found that student learning hicreased 
when itudenti we^ enpged in ttski that produced a low rate of errors 
that iSs in tasks on which they made few mistakes these mistakes were 
the result of carelessness ratiier than lack of knowledge or understanding. 
Suppose this flnding were presented to a teacher who believes that it ^ 
appropriate, on occadon, to aMipi tasks that students initially find baf- 
fling. In taking amount of the BTES error rate finding should this teagher 
discard hte/her belien I think not. 

What I am calling bafflement^ PIrug (1974) cdli stuckness. He says» 
**Stuckness ^oiUdn't be avoided. It's the p^rchic predecessor of all real 
understanding'' (p. 2S6), Perhaps students would beneflt from experienc- 
ing stuckness, learning to deid \^th it as a productive way into a worth- 
wMe problem. The continuous pro^sion of tasks that produce low error 
rate, conjoined with such practices as sm^ stepSs assured rea^ess for 
entry, and controUed successive approximations could pro^de an inho^it- 
able climate for learning to meet the challenges of independent problem 
solving. Hus po^bility is based on my obser^tion of the peat feelinp of 
insecurity exhibited by coDep students when they are ^ked to imdertake 
m inqui^r for which the boundaries and the criteria for success wfll not 
become clear untfi they are weU mto the tM$\L Many studenti seem almost 
fri^tened to get underway, a^arently never having had the experience of 
entering a room fun of ideas wMe the U^ts were off. 

On the ottier hand, coUep students are certainly not s^ond^ or fifth* 
pade students learning the elements of rea^g or ma^ematics. Perhapi 
there is a far peater neces^ty at these lower levds to plan for taste that 
produce low enor rate. Hie point seems reasonable enough. Yet my beUef 
about bafnement would moderate my acceptance of the error rate finding. 
If I were a second-pade teacher, I woidd dhoose to spend a modest 
amount of time introducing students to bafflement, helping fliem to deid 
comfortably with it and learn to turn it to advantap. Despite the triteness 
of the aphorism about not throng the baby out with the bath water, it 
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flts here. The ividenci prtisnted by the error rate finding does not negate 
my oripnal belief about bifflement; it enlarges this belief. The finding 
alerts me to the necesiity of distinguishing clearly between tasks that 
produce low error rate and tasks that produce bafflement, and instructs 
me to consider the differanees among students when allocating the propor- 
tion of low error rate and baffling tasks* As suchp the finding becomes the 
basis for adapting, but not reversing or discarding, my oripnal belief* 

Given this discussion of bridgng with e^ddence, it is now possible to 
contrast this form of bridging with the use of rules. Rules are imposed 
with the expectation of obedience, while evidence is presented with a 
request for serious consideration. Rules are impriclse representations of 
research findings because their constriction requires the riUemaker to in- 
terpret the findings; evidence conveys to the practitioner precisely what 
researchers have learned from their inquiries. To adapt or ipore a rule is 
frequently regarded as an act of subversion, wher^s evidence may be 
freely and opiiJy accepted, rejectedi or modified. The imposition of rules 
can leave both sound and unsound beliefs equally unaffected, while the 
consideration of evidence encourages the clarification and assessment of 
prior beliefs. Bridging with e^ddence accords the practitioner the status of 
a thinldng, reasoning person; brid^g with rules treats the practitioner as 
if he or she were little more than an automaton. These distinctions drawn^ 
the way is clear to discuss the third form of bridpng, 

Bridpng With Schtmata 

A schema is *'a summarized or diagrammatic representation of some^ 
thing" (American Heritage Wctionary, 1969). Schemata is the plural. 
Schemata provide a way to "see" a phenomenon and a way to think about 
it.3 Bridpng with schemata provides a way for practitioners to grasp, in 
descriptive and explanatory ways, features of their work. The BTES con- 
tains several powerful schemata of cla^room teaching. Among them is the 
time ^hema. 

In a fascinating account of the notion of time, Jespersen and 
Fit2-RandoIph (1977, p, 3) contend of time that "we can spend it, save it, 
waste it, or kill it, but we can*t destroy it or even change it, and there's 
never any more or less of it," Thk last phrase, "there's never any more or 
less of it,** is true of our generic concept of time. But if we consider how 
time is used by those who make lesson plans and acti^aty schedules, a 
different, more elastic perspective on time emerges* The BTES draws a 



3Th§ tann **schemati" has also been used by Anderson (1977)^ but In a manntr 
difftrent ffom thi way it is used in this chapter. 
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distingtion b@tW€in ^oeitid tiirii and anpgid time, TTii timi lit Hide 
for in^ruetional miMtln ii aUc^atid tiim, Hit time students are activily 
puriuing aeademibally ^leimnt tasks is enpged time. The notion of 
Aeadimk Learning Time if an even further ^flnement, ALT is "time 
spent by 1 student engaged on a task on wWeh few erroi^ are produced, 
md wheit the task is directly relevant to an academic outcome** (Fiiher it 
al,, 1978, p. 2-4). A major finding of the BTES Is that ALT is podtively 
associated with student learning* This podtive association implies that if a 
student's ALT is increased, he or die wiU show a pin in learning. TWs 
schemitization of time in the BTES suggists that a practitioner can ex- 
pand or contract the different Idnds of time that characterise classroom 
settinp. 

Tile time schema is a potent one, primarily because many of us are 
simply not oriented to "seeing** time when we obsirve classroom events. 
We have not been alerted to the value of emplo^dng our physical senses to 
detect and measitti-how time is used in school settinp. However, the 
manner in which time is conceived in the study offe^ a mains to describe 
and explain what happens in classrooms, with languap md concepts not 
previously available* As Borg and Romberg point out in preceding chap- 
ters, many earlier studies of teacher effectiveness looked dirictly from 
what teachers did to what students learned. TTie BTES looked from what 
teachers did to how students behaved, then related student behavior to 
student learning. The research team devised the time schema as a means of 
stud>dng student behavior in the cla^room. 

The schema contains a number of concepts for classifying and analysing 
classroom time: allocated time, enpged time, academic learning time, wait 
time, break time, and transition time. (The preceding chapter by 
Rosenshine explahis these concepts and describes their use in the study.) 
In bridpng with schemata, these time concepts and their interrelations 
would be presented to practitioner for the purpose of enabling them to 
"see** teacher-learner intemctions in a tempord dimension. The time 
schema provides a summarized and diapammatic representation of se- 
lected classroom phenomena. Using the schema, practitioners are able to 
conceptualize cla^room events in my% that clearly relate teadiing behav- 
iors to student leaming-'a relationship that untfl now has been obscure. 

A second BTES schema deals mih teaching beha^ors, Hie teacher 
behavior sdiema distinpilihes between instructional settinp In whidi stu- 
dents pme thwmelves and those in which student work is paced by othefs. 
It. distihgui^es teacher planning beha^ors (diagnoms mi prescription) 
from interactivi teaching behaviors presentation, monitoring, ^d feed- 
back) and substantive teaching behailor from procedural teadiing behav- 
ior, Analyds of the data indicates that some combinations and patterns of 
teachini behavioii are more productive of student enpged time than other 
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combinationi and pattemi. On the basis of this analysis. It is possible to 
link the time schema ^th the tiachlng behaviors schema to produce an 
insi^tful and suggestive way to look at and think about the conneations 
between teaching and learning. Brid^g that imparts both these schemata 
pves practitioners a means to describe, analyze, and appraise the classroom 
settings in which they work or over which they have administrative or 
poUcynialdni authority. 

The value of brid^g vnth schemata lies in providing practitioners with 
tiie means to structure their fXperiences wi^ the classroom. Education, in 
its larger sense, is the pro^sion of means to structure experiences in ways 
that continually enlarge knowledge and understanding. We all have experi* 
ences, but it is extremely difflcult to achieve deep and sophisticated under- 
standing from experience alone. It is education that pro^des us with the 
means to interpret and evaluate our experience, and to do so in a manner 
that allows us to become more raUon^ and more moral in our actions. 
Broudy (1972, p. 82) argues: 

When iifi pfidi^ments gan bi r§soivid with commoinense ganaraUEa^ 
tionSp enc learns by li^g; when common senii is insuffident, one his 
to learn by eoniprthendini knowledp diseovered and formulated by 
. ©theri. How far doas gommon s§nsa and personil experien^ go, these 
days, in thinking about poUutionj Inflation, the proWems of health and 
pea^? 

Among the means available for structuring our experience are the 
schemata devised by researchers and theoreticians. Unfortunately, 
schemata derived from educational theory and research are sometimes 
rejected out-of-hand by educational practitioners. At times this rejection is 
for good reasons, as when the theoty or research is almost completely 
unrelated to the realities of practice, On other occasions, the rejection 
stems from an undentandable but unjustifiable failure to comprehend the 
theory building or research enteipriie. To study a setting, researchers are 
compelled by their purpose and their methods to reconstruct that setting. 
This reconstruction is based not on the reiearcher's experience in the 
setting (though that may be a contributing factor) but on how the re- 
searcher must conceive a problem in order to seek a solution to it. ITie 
result is a frame of reference and point of view that is Initially surprising 
and confusing to many practitioners. Scheffler (1973, p. 77) states this 
point ftrce^lly: 

What the identiit rejectl IS the rida of the familiar. His Job is preeiidy 
not to take for ftanted thi eustonffliy Goneeptual apparatus of his 
enwonment but, through ^tidim and invention, to develop more 
adequate intelleetual iqttipment wWA wUl ineompass thii very envi» 
ronment along ydth othif actual and poidble ones, 
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Bridgng sehemiti r athir than miuly with evidenei, or solily wth 
rdiSp IB made dlfflei^t b^auif the risaardier has rejaetid the familiar 
whfli lha praotitiontr cUnp to it as a mewis of making mnm out of 
fxpiritnca wiA thi work sitting, "nus difflc^ty has to ba overcomg if tha 
praetitionar is to pin the ad\Mtaga of employing rasaareh sAamata as a 
means for structuring axperianea. If ft© difficulty is overcoma, the schamata 
are av^abla as contributions to the fducation of the praetitionar, 

Thm far thto discusdon of sehemata has presumad that tha Intaraction 
batwaan resaarchers and practitionan to a one-way affair, from rasearchar 
to piBCtitioner^ That tfus prasumption emarps from tha discu^ion is a 
ftatura of toa particular topic baini examined hare: How ara tha knoyA-' 
adga and underitwding gained from rasaardi on tabbing transferred to 
tha educational praetitionar? If tha la^ar pictura were the coneem of this 
chapter, it woidd not be naeessa^ to dapiet taowladp and understanding 
as flowing only from rasaarcher and praetitionar. The re^archer has much 
to laam from tha axperience, indghfe, md laflactioM of tfta praetitionar. 
It is becoming incraaringly clear that researchars who ipore the reditias of 
practica not only risk destroying the value of their work for practice but 
may also Jeopardiza tha i^erent quality and sipifle^ce of their research 
(Fidiar and Berliner, 1977), 

Another caveat is in order. Not all research providas new or powerful 
schamata* A proportion of research work is devoted to replicating the 
findinp of previous rase^di, or studying phenomena for which new 
^hamata are unn^e^ary, Resaardi ^thout idiemata, however, is stUl of 
value to practitionen, It is a source of e^ddenca for assasdng the reason- 
ablene^ of beUafs about teachmg and laanibig, 

Brid^g Effactlytly 

Tlirea Wncb of brid^g between researdi and practiee have been da- 
scribad. Biidgmg can be done with rules, with evidence, or ydth schemata. 
These ara probably not mutually axcludve categories; hence canbinations 
of any two or of ^ time are posable. Wiat 1 have tried to make clear are 
the ways aadi is performed ^d their consequ^ces for the adueation of 
practitioners. Hie underlying question throu^out has bean: How Aoidd 
bridgtag tal^ place, givan a cmcept of what it means to partidpata in the 
education of a fellow human bdng? V^t has not yet be^ addreMed is tha 
mora factud qpiestion: Can resaarA on teacher effectiv^ess enable a 
teacher to become mora affective? 

The aniwer to this ^cond question de^nds, I think, on how you 
choose to define affectiv^ass, b an effective taadier one who is able to 
produ^ dmonstrable pins in student adiievement in sudi basic sWUs as 
reading and ariAmetia? If lo, there is much to command the use of rules 
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in bridging the BTES and similar studies with educational practice* If 
teaching is exclusively a skUl the characteristics of which are well defined, 
then it may be posiible to formulate rules governing the exercise of this 
ikilL In this ca^t the teacher demonstrates the skUI of teaching by closely 
adherhig to and following the rules* Even in this fairly ri^d view of teach- 
ing there is room for display of discretionary performance by the teacher, 
But this discretionary authority exists ordy because it is surely impossible 
to ever write a truly complete r^ebook. If such a book could be written, 
discretionary authority would be at an end* 

In contrast to the view that effective teaching is the production of 
demonstrable gains in student achievement there stand 30 centuries of 
philosophic literature on education, most of it arguing a conception of 
education not wamly received in the contemporary political and profes- 
siond milieu. 'Hiis literature suggests that teaching is a sidll, but also more 
than a sldU* It is not solely a phenomenon that conforms to rules but is as 
well a phenomenon about which we can have knowledge. If teaching Is an 
activity about which we can have knowledgCj is it not reasonable to con- 
tend that those who teach ou^t to have what knowledge is available 
about what it is they do? If the answer is affirmative, it is in support of 
bridging with evidence and schemata, for that is precisely the point of 
these kinds of brld^gi to prowde to teachers and other educational prac» 
titioners the knowledge that others have about teaching, 

TTieri is a problem with this position. It has long been recogiized that a 
person can know what is right to do but still not do the right thing* Can 
such an argument be made about teachers— that their merely knowing 
what is required to produce demonstrable pins in student achievement 
does not ensure that they will do these things? Yes, this could be said. But 
it misses the point. It assumes that the production of demonstrable gains 
in achievement is the sole criterion of effective teaching* It could be 
argued that an effective teacher is one who knows a great deal about 
teaching. This argument is not likely to withstand the extraordinary pres- 
sures of accountability in these times, so it is best not to push it too far* 
Fortunately, there is another alternative. 

An effective teacher is one who successfully provides to students the 
means to structure their experiences in ways that continually enlarge 
knowledge and understanding. 'Oiere is little doubt that reading and arith- 
metic abilities are critically important means for structuring experience. 
Actually they are means to other means* ^t is, by being able to read and 
calculate, we are able to gain access to literature and thought procisses 
containing the concepts, theories, and methods which enable us to contin^ 
uaUy enlarge our knowledge and understanding. Thou^ I have but tacit 
evidence for it, it does seem possible to teach someone to read and calcu- 
late without enabling their access to the literature and thought processes 
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inlarp thiir kQowli dgi and undfntan^g. It is for this riaion that 
I ^gui for treating idugational pFaotitioni is ta mys that provida good 
modils tot thtif tr§itoi§nt of leani§n. 

In ibianai of wattainabl§ ^rtainty about the best way to t§aeh 
effi^tivilyj ndis Aoidd be sparstj ividgna§ plintifulj md ichimata fol- 
lowf d to whirivtr they n^t lead, TWs ad^^^ taton sirioudy, would 
privent one outeoma that ihoidd npt bt the risidt of ^search: the oonvir' 
son of re^arcA flndlnp into ideolo^ or dopfia. Brid^g with e^denca 
and schemata avpidg idiolopeal and dopnatie interpretation. It is a way to 
gam fldi advantap froni the ^minal insists and perspeetives afforded by 
tiie Beginning Teacher Evduation Study, 
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BTES: Implications for 
Preservice Education 
of Teachers 

Karm B. Kepler 



"So whit's niw?" may bi a common raaetion monpt presarviQt 
tiiohir iducators to thi BTES report. Surt, most of ua accipt thi idia 
that •Hiaehing procisae s affect itudint cla^room leamiiigi wUchj in turn, 
affects studint aduevemint'' (lM).i And most of us would probably 
Bffm that thi abflity to dtaposi, prascribi, pre^nt, and monitor instruc- 
tion and prowda feidback to studinta ara iMentlM tgacWng skQIs* And, if 
mcreaiing reading and maft adiiavimint scoris is our aim, it iiims almost 
ob^ous that incriasing tha timi rilocatad to tasta ipaciflcdly relavant to 
the tist^ ijnprovini students' attantion, and rai^g tha proportion of 
rasponsa opportunltias which indicate mastao^ would be useful. Not only 
do tha model and flntop appear commonsensicd, but th^ probably 
leflaGt prindples diaady undarlying most prasar^dce teacher education 
propams. 

But it would be unfortunate if the *'not new*' response lad ^adari to 
d^misi tha study prematurely or to jump to impUoatlons for restructuring 
teacher education propantt or certiflcation procedures. Neither reaction 
does Justice to tfie BTES research effort or to the cautions whidi the 
researdiers offer In tha tachnieal report version of the study. 

Rather^ those con^med ^th prasenica education should study the 
unabridged edition, discu^g the undarl>dng assumptions and the validity 
of the findings before conddeilng impUGations. Under study, the report is 



Ita wiitfa^jtWi ^per, I am ^mmentoig on two BTES doeument^ atations from 
the "iumn^ry" docimifnt are noted by ptge numbers, atations from the tgdiniad 
feport not^ by ^pter and page number (L^, 5-23 fefcra to dmpter S, ptp 23)* 
Gtations torn other works v/iD. be noted by author's namt and page referent. 
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bomid to gensrata rniny questions and resarvatiom as wall as tricar some 
thoughts about implications for practice* Tliere is much to tdk about 
hara-^issues that teacher educators have to face reprdless of their judg- 
ment about the substantive findings of this particular report. 

In this paperj I have orgamzed my own comments in a manner which 
will hopefully be useful for discussion regardless of reaction to my particu- 
lar views, which are certainly colored by my experience and present cir- 
cumstances.^ My reactions fall into three categories: 

L Urwierlying assumpttom, wWdi raise questions about the useful- 
ness of the BTES fln^ngs for teadier educators. 

2. Problems in the pmentation of the findings, whidi may be par- 
ticularly troublesome for preservice educators* 

3. Implications for preservice education 

a. Resent implications 

b. General implications^ ^en and if knowledge base is 
strengthened. 

Bafora proceeding, let me reiterate that I am reacting from my own 
limited perspective. And I am maldng no assumption about the generaliza- 
bility of my opinions* They are offered merely as a catalyst for discu^ion* 



Underlying Assumptions 

ThB BTES study ampiricdly examined hypothesized relationships 
among teadiing process variablest Academic Learning Time (ALT), and 
student achievement* According to the model, teaching processes affect 
student classroom learning (ALT), which, in turn, affects student achieve- 
ment (flpre?.!)? 

There are several assumptions implicit in the desip, mterpretation, and 
dissemination of the study which need to be clarified* These clariflcations, 
most of which are offered as cautions in the unabridged technicd report, 



^My dureet experiinoe is a prei§fvi^ teachir idu^tor hai been in i imill Ub^il 
arts eoUege and a large, yrban imivtfSity* I havi tau^t and supf rviied in K-9 public 
and im^te sdiool dassroomi in Boston, Qeviknd, iububtn Chi<^go, wist^n 
MasMehwtts, and New York Qty* 

3Foi €Onditeney, I have substituted the t^m sueeiss rate- used In the 
summaiy report for the or^nal term, "low enor rate," used in the teehni^ report* 
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Tetdiitig prooeiias 

Fresantatioii , 
Monl taring 



ALT (dissrooni leimlni) ^ 

Tiini aUrated to riie^nt 
talks 

Enppment 

Hi^ iUQCigs rati 



Qassroom tn^ronmant 



Reading a^i€va^ 
ment teiy 

Math lahie^mf nt 
tasy 



Studint apdt^dei 



diirly UnUt tha flndings as a souroa for restruoturing pFfservioe aducation 
or Qairtifi^tion proaadurai^ Given cartain value oriantations, thi dariflaa- 
tions avan cast doubt on the advisibflity of intepating the flntop into 
axistlng prasarvigi cu^auluni or supemsion practiaes. 

In thinking about what BTES maans for praservlei education^ I find 
tfiat three sets of underlying assumptions are unsattUni: (l)the narrow 
vbion of '*teaahing md learning" in dementary schools implidt in the 
resaaroh dadgn; (2)tiie particular vilug oriantatlon wWdi parv^das the 
interpretation of tha data; (3) the "simplify/don't qualify" approach to 
diisamination impUdt in the summarias. 

Th^ vision of "taaching and learning-' in elemantao^ schools implidt in 
tha raiaardi design is limited on many dimen^ons. As profassionals ra- 
sponsibla for praparing dementary sehod teacharsj we must ramambar 
that tha findings are U^tad to laaming in raadlng and math as deflned by 
standardized aduavament tests. Otfiar kinds of copiitive laaminp in thasa 
and other iubjeetl, as well m affectiva goalSj ara not addressed in tha 
prasant ALT modeL^ As tha reieardiers remind us, both ALT and achieve- 
ment tests are usafid, but mcomplatej measures of student laaming (7-34). 

AdditionaUys the results are generated from research in classas wWdi 
"tended to ba relatively taadier centered" (11-32), And from the class- 
room examples ^van (8-19 to 8 J 2) and the rasaarchij^' comment that an 



^Althou^ not r©presented in the ALT medel, i Ifr to 2S-item miisura of atti- 
tudes towiid ria^g, n^thetnati^g and idi^I ms adminiiteied and an i^ploratoryp 
iiQn^ncluMve ^alyds conducted. Ihe lisaarditri su^iit "it would be disbable in 
futuie divdopment of the ALT modd to inolude ttudent attitudii gg a oomponent 
of the model" (9*1% And it would also be dedrable to include o^er cosiitivi and 
afTictive foils as outcome measufes bi further developmant of a model of **teadiing 
and laaniing in dementary spools," 
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allocated time block is the "maxmium timi available" for a pven subjict 
(2-3) tod the fact that field trips and Chriitmai plays are lost time (9), one 
Infers that these wire mostly classrooms whire academie subjects were 
tau^t di^retily rather than in an intepatad or project-oriented fashion. 
TOs apparent selection bias limits gineralizability.^ And wwing the allo- 
cated time bloak as the "maximum thrm avaUable" (2-3) may ilimlnate a 
possible dlitingui^ing factor between more effective and less effective 
tiadiers. Pirhaps discrete time allocation interacts with opportunitiel for 
reinforcement during otlier "subjectSi" providing a more powerful impact 
on achiiViment. For instanGe» the teacher who not only aHocates a speeiflc 
time for reading and math but con^ientiously reinforces reading and math 
skills while teaching social studies^ science, music, art, etc., may be the 
most effective.^ 

Even more critically, the flndinp are based on students who scored in 
Uie 30-60 percent achievement range on both tests* We do not know if 
these results hold for children in the bottom 30 percent or the upper 40 
percent or for children ^?^th one score ou^ide the middle rangeJ For 
instance, one rt^t speculate that hi^-achieving children mi^t need less 
substantive interaction, prefer a more chaUenpng modemte error rate, and 
become bored ^th increased reww time on skill-oriented achievement 
test material which they have already mastered, IHiere is some tentative 
evidence to support this counterhypothesis in the less-than-consistent find- 
ings at the fifth-pade level (1 1-22). 



5 1 say "apparent" be^iMi the sampli re^ei§ntativgnasi may be less reittietid 
than the eHamples imply. If io, thire ii ob^oudy a need far a better deseription of 
the dii^ooms under itudy. 

^After readtog a draft of thii ehsptiri Riehard Marliaye has indUi^ted tliat the 
If iearehers* theoretic^ charaetertzation of "maximum time av^able" did not eon- 
strata data coUection on i^ocated time. It is good to lewn that reading In ebntent 
areas wai ineluded mthin reading ^o^tion totak, rin^ I had reeeived a different 
perception from tiie following statement hi the report! *'MQSt of the detafled 
took (to® dming riding and mathemati^ instrugtion, for wUdi spedflg eontent 
oitegorie^ student behaviors^ Mid Sudent teadier interaetions were aU recorded. 
Howe during other tosttuetion^ ictMtias, sudi as sdenei or ^ a gsieril code 
was suWident** (3-11), I stm wonder whether the observational coding sdiediae was 
seniitivi enou^ to pick up the mriety of ways math and reading can be reinfor^d in 
othCT subjeetSi in activities and projects, in free time, and in nmnapiial interactions, 
Additiondly* it is hard to determine the impact of the ^ded rebted content in 
lead^g and math, sin^ aU tiie deseriptive and tnilydc tables have lumped such work 
under reading and math totals (e.g., 4-8, 4-17). 

^Int^eitbi^y, almost one-third of the orlpnal volunteer classooms were elimi- 
nated from the study be^i^ they did not have at least ax cMdren fdUng m die 
30-60 perMt ranges on both teits. 
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And despite the importance of social class found in other recent studies 
on direct instruction, social class differences were not exanuned* In review* 
ing classroom instruction studies, Roiendiine (1976) describes the rela- 
tionship between social class and several relevant variables (e.g., individual 
vereus group work, oral responding versus ^atwork, percentage of correct 
answers, feedback strategjes, frequency of teacher questioning about self, 
proceduml versus substantive contacts, student-initiated contacts involving 
person^ concems> In light of the BTES flndinp on the positive relation- 
ship between achievement and high success rate, Rosendiine's conclusion 
about the difficulty of questioning is of particular importance: 

ThmB resets iugpit that ths diffi€tilty of questions should ba the 
difld's levii of lUUty in das^Mtim with diUdren of low loeioa^nomic 
stetus, whereis it is better to ask quaitions dighUy above the Afld^s 
level of ability m olaimonis with children of sodoe^nQinie status 

mix 

Hence, in talldng about the flndingSj we must remember that the study 
was desiped to address only certain aspects of test-related teadiing and 
learning in apparently relatively traditional elementary school classrooms 
for children of average achrevementp undifferentiatid by social dass. 

Another limiting factor is the particular value orientation wluch per- 
vades the data analysis and interrelation. As a February 1976 technical re- 
port noted, '*lhe BTES staff shareSp with other researchers, a ^ovdng belief 
that direct instruction is a causal factor in student achievement'* (Berliner 
and Rosenshlne, ii). Hus orientation influenced not only the desipi of the 
study but alBOj understandably, the interpretation, dnce the study essen- 
tiaUy became a vdidation of the relationship between "direct instruction" 
factors and adiievement. Perhaps because of their belief in the model, the 
researches appear to have played down the value decisions involved in 
interpreting the findings and certain contradictory residts. 

For instancei the report suggests that chfldren score better on addeve- 
ment tests if more time is allocated to task-relevant activitlas. Wiile Ae 
issue of the importance of improving reading/math achievement scores 
Illative to other goals is aclmowledpdi it is deemphasized, and the desir- 
abUity of more time is implied in the discussion of the flndinp. We read 
that, on the average, 66 percent of instructional time in these second- and 
fifth-pade cla^s is already devoted to reading, language arti, and 
mathematics.8 Then, in the description of an effective teacher, WTES dim 



8ln the m^nd pgde, 5 ^rcent wpi devoted to other academic lubjegts (sodil 
studies, sdeiici) aid 29 percent to nona^demic subjects (art, muiie, physical educ- 
tion)* In fifth pade, 7*1 1 per^nt was dented to other aQdemic iubjerts and 22=27 
percent to nom^demic subje^ (4=7). 
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the example of a second-grade teacher who devotes 80-89 pircent of each 
day's instruction to reading, language arts, and mathematics How 
much is enough? Too much? 

Hie implied caU for more time to be allocated to reading and mathe- 
matics instruction involves many value judgnents— judgments about priori- 
ties among goals and among students^ the importance of increasing math 
and reading achievement scores, the definitions of success criteria, the 
Valuing of mastery versus coverage exposure, quantity of time versus 
quality of experience^ maximizing versus minimizing individual differ- 
ences, and the focusing on ALT variables which accounted for 10 percent 
of the variance in achievement rather than on the teaching process vari- 
ables which accounted for an equal amount of variance, Hiese decisions 
involve value jud^ents which should be debated rather than hidden 
among a set of fin dings which appear definitive enough to generate specific 
policy statements. 

Whfle I anr. definitely an advocate of direct instruction as an important 
part of elementary education^ a possible bias in the analysis and interpreta- 
tion of the data makes me uneasy. Let me give several samples: 

1. The use of ,10 as the level of significance rather than the ,05 level of 
significance more typically used in social ^ience research. 

2. The use of overgeneralization and implied si^ificance* For instance, 
table 4=6 of the summary report, which shows the effects of engaged 
time (A-B period) on achievements, lists one .01 si^iflcance flndingj 
two at the .10 level, and eight nonsignificant findings for the second 
grade. At the fifth grade, there are four findings significant at the .01 
level, one negatively significant at the .10 level and seven nonsignifi- 
cant findings. Yet we read: **The results of table 4-6 indicate that 
engaged time was positively related to student leaming," At the end 
of the paragraph, we do find a quahflcation: *'It should be noted, 
however, that no si^ificant effects were found in grade 2 mathe» 
ma tics or grade 5 reading for the A-B period on enpged time" 
(448). 

Similarlyj in chapter ITs report of the regressions analyzing the 
combined ALT effects, we find a deceptively conclusive statement 
that "student engagement rate during allocated instructional time in 
reading or mathen^tics is positively associated with learning" (il'8). 
The following parapaph, noting some qualiflcationSj leads us to 
believe that a more significant relationship exists than is actually 
evident in chapter 4 (4-30 to 4-33).^ And than, even the 
qualifications are totally missing from the more abbre^dated 
summary report. 
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3* nie use of linear extrapolation. Although the authors warn about 
the speculative nature of using linear extrapolationsp they write that 
linear extrapolations "indicate that intentional manipulation of one 
ALT variable^ allocated times could produce substantial and impor- 
tant chanpi in student achievement'' (^39). 

4. Causal iiite^retations infened from correlational data. Correlational 
data slide into causri interpretations in the summaries despite 
waminp from the researchers in the technical report. 

5. Description and prescription distinctions. TTiere is a confusing 
tendency for descriptive data (i-e., success rate or seatwork ve^us 
ffoup instruction) to become the norms for prescriptions of more/ 
less and hi^/low. For instance, 70 percent (mean: 70-75 percent) is 
set as an enpgement go^ (7»22); worjdng at a hi^ success rate 
means anything more than 50 percent of the time (mean: 50 percent 
at grade 2; 3446 percent at ^ade 5) (4-1 1 ); allocatijig two-thirds of 
the time to seatwork (mean: 60 percent) is seen as having a neptive 
effect on attention (11-5). 

hterpretation for pmctitionert is made difficidt and relative because of 
the confusion between description and prescriptionj the unexplained basii 
for prase riptive decisions when ^ven, and summary statements which do 
not mention the numbers used by the researchers in classifying, describingi 
md prescribhig. 

My third area of concern is the implicit assumption that it is desirable 
to "simylify/don't qualify" when disseminating research findings to practl- 
tioners and the general public, I do apee with BTES' viewpoint about the 
use of iess-than-deflnitive data: 

it is worth r@c»piMn| thit one may ^asonably base a belief on inc^n- 
duiive evidensai No knowledgi is ever abiolute. Even experim§ntal 
anaiyiei ire gtnt mUy open to more than one reasonabli interpretation, 



"in the sumRmry tables 444 to 4-lS, we flnd the foUomng dgnifiance reported 
at theaOIevd: 

Grade 2 reading (3 out of 4); inith (1 out of 7) 
Grade J reading (1 out of 4); math (2 out of 8) 

Pmod 

Grade 2 reiding (2 out of 7)| math (none out of 10) 
Gmde 5 reining (1 out of 4)| math (2 out of 8) 

Referrinf to table 4-1 2* we find that none of the rilationshlps in the A-B period is 
d^ifiwt at the .01 leviL (Table 443 for the B-C period is a blank pap in my two 
^pies of the report*) 
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piftiG tiigr iy when on€ ^^Wes to gengf^ize to naturil dtuitions and 
events. Correlative data ^nftined with experiential knQWiedfi and 
logi^ rewning often provide eonddertble e^denoe for ^usal lela- 
tion^^^ One should rego^iie the Unutations of such evident, but 
not dl^^ird it (4^36). 

Yet I do not think the findinp should be presented in such a clear, 
imqudified mannir as to suggest definitive resdts which in turn yield 
premature prescriptivi statemints. The summaries reported in ehapter 11, 
which do present some quaUflcationSj are in striking eontrast to the un- 
qudifled major flndings reported in the summaty report. Not only is this 
misleading, but it d^s not let the reader decide how much inconclusive^ 
ness is appropriate. Rather, it leaves the judpient up the BTES staff, who 
are admittedly already favorably disposed toward direct instruction. 
Granted, the dissemination of qualifled findinp provides a particularly 
difficult problem because the audienae is already skepticd about the 
utility of educational research findinp. But my sense is that the BTES 
researches have gone too far in making their findinp sound more deflni- 
tive than they really are. 

My discomfort with these three aspects (narrow vision of **teaching and 
learning," the possible influence of reseMChers' biases, and the '*simplify/ 
don't qualify** approach to dissemination) make me hesitate about empha- 
sizing prescription in this implications paper, Ob\iousiyj there will be 
others who are not troubled by these problems-yet I believe that Aey 
should be clearly understood by aU who are discussing the implications for 
preser^dce education and that qualiflcations dioidd be clearly stated hi any 
policy impUGations emanating from the BTES flndings, 

Problems in Pi^entation of the Data for Preservice Educatofs 

Besides the limitations discussed in the precetog seetionj there are 
some other problems in the presentation of BTES for those of us who 
work with preservice studente* lliese problem areas include the overall 
messap, allocation of time^ hi^ success rate, poup work versus individual 
works academic versus affeetivei and statements about curric^um. 

OveraH Message 

Most pre^rvice students are arudous about how successful they will be 
m student teadiers-and most are somewhat overwhelmed as the com- 
plexity of claMroom teaching unfolds. Memories of their own experience 
in elementary school-both good and bad-^help to create a sense of famili= 
arity and idedi^d visions. In the classrooms^ new dimensions appiM- 
dimensions which cannot be prepared for in coursework* Many Important 
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elements such as feiUng comfortable with the role of authority, appro- 
priati pacingj or "with-it-ness" can be adiievid only throu^ actual 
experience. Preservice educators* be they college supervisors or coopera- 
ting teachers^ play an important role in helping preservice students cope 
with redity and evolve into efftctive teacherB. We can ^ve students a 
general framework, speciflc knowledge and skills, some tricks of the trade, 
feedback on their performance, and suggestions for the future^ and we can 
model good teaching, problem solvings and critiquing. But we cannot pass 
along one recipe to be followed by all preparing to teach elementary 
schooL 

Not only are we without a validated recipe, but differing values, per- 
sonalities, and contextual circumstances preclude such an approach to 
teacher training. Out of necessity most of us must prepare students with a 
plurdistic view toward teaching and learning. And information from a 
recent national survey of teacher education programs indicates that faculty 
and students do accept ideas about teaching and learning which represent 
many different orientations. Wule this acceptance could be interpreted to 
mean a "lack of differentiation among orientations/' it might also mean a 
clear tolerance for multiperspectives (Joyces 1977s p. 15), 

Keeping the BTES model in a multipefspective context and qualifying 
these particular findinp will be a challenge for preservice educators who 
believe there is no one ri^t way to teach/leam for aU studentSj all 
teacherSi dl goals, all subjects. Althou^ the BTES never claims that it 
presents the *'recipe" for aU teaching/learning in the elementary school 
the centrality of the direct instruction model and the implied unqualified 
prescriptions may be misleadingi particularly for preservice students look- 
ing for the way. 

Allocation of Time 

Allocation of time proved to be one of the strongest variables in ex- 
plaining residual variance of achievement scores (4^38). Unfortunately for 
preservice students^ this is the one variable over which they have the least 
controL GenemUyi cooperating teachers determine how time is allocated 
i_n the classroom. 

In discussing how preservice students might allocate time in their future 
classroomSj we cannot leave them with the impression that more is better. 
Even if we accept the value orientation of the BTES model and recom- 
mend that more time be devoted to reading and math, we clearly need to 
address the possibility of diminishing returns and the negative impact of 
too much time. We need mom research about limits of time allocations 
and descriptive studies indicating how good teadiers know when more 
time is worthwhile. Obviously, in further pursuing this issue, we wiU find 
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oufsalvas in the realm of value judpnents-but this is fine. Preservice 
students must understand that such decisions do involve value as weU as 
objective judpnents. 

High Success Rate 

Advisiiig presendce students to desi^ learning experiences which yield 
a *'hi|h succe^ rate'' is fraught mlh problems because of the contra- 
dictory evidence in the BTES study (i.e., inconsistent fmdlnp for the fifth 
padel^ and the lack of relationship to planning variables, appropriateness 
of instruction, knowledge of subject matter, allocated time in second 
pade, etc.). It ^so presents problems becauM of the narrow range of 
students for which it mi^t be appropriate; the different rates advisable at 
different stages of learning, at different times of the year, at different ages, 
in different schools;!! and the confusion around what proportion of time 
indicates "high success rate'* and the appropriate baiance between high 
and moderate success rate. 

Since most student teachers intuitively know that a lesson is "too hard" 
if the children can only answer correctly at a chance rate, the critical 
bdance is between high and moderate success rates. From the BTES study, 
we know that spending 50 percent of the time at a hi^ success rate was 
the norm for second grade, and the norm for high success rates for the 
fifth grade was 34 percent in math and 46 percent in reading. BTES 
recommends that students work on material which yields a high success 
rate for them at least half the time (11), Yet in the descriptions of six 
second-grade "outlier"' classes-those differing most from the average-we 
find i. a high success rate for hi^-achieving classes (readings 59 percent, 
64 percent, 32 percent; math: 66 percent, 73 percent, 55 percent) and 
low-achieving classes (reading: 64 percent, 47 percent, 39 percent; math: 
51 percent, 59 percent, 37 percent) demonstrating quite a variety (8-16). 
We also know that the results were not consistent at the fifth-grade level. 
Where does BTES get the 50 percent figure? And, if it is 50 percent, 
wouldn't it be clearer if the conclusions were stated using a less misleading 
term than "hi^ success rate*'? For in reality, "high success rate" does not 
mean a high "high success rate'* but rather a moderate **high success rate*' 
combined with an almost equal dose of '^moderate success rate.*' 



IWFifth^adi ex^tions: 4-28 to 4-33, 7'36, 9-12. 1 1«8, 1 M2, 
llTh§ sdiQOl normi nay be another faetor fffectinf stud^t respons§ to the 
hi^/m§dium suc^^ rate balance. In a year-loni study of ieventh paderi, K§pl§r 
(1978) found that most ttachers iiked questiom whidi thi risponding student 
answered oor^gtly 85 per^nt of the time. The one tidier who generated the most 
negative effeet asked questions that yieided a 67 pereent correet response, De>^ation 
from the sdiool norm rather than Uie balan« of Ugh/medium may have b^n the 
tfiti^ variable. 
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Apin, we come to a research question which needs to be answered: 
Wiat is the appropriate balance? How do teachers make jud^ents and 
adjustmerits in success rates? How much review and practice is necessary? 
What happens in whole-group instruction when children achieve 100 per- 
cent success rate at different times? How do you know when to move on? 
Againj not only research flndinpj but value judgnents about priorities, 
mastery levels^ and coverage come into play in these decisions. 

If the advisabUity of the "hi^ success rate*' proves more universal, if 
the appropriate balance between medium and high success rates becomes 
clearer, and if the lopstics can be worked out for the normal hetero' 
geneous class of 25 to 35, the challenge for preservice educators mil be to 
make sure that student teachers do not unwittingiy faU into lowering 
expectations to provide their supervisors with evidence that they can teach 
so their students make few errors. Just because students are producing 
many correct responses on the task does not, contrary to a BTES state* 
ment (3), mean that students are learning. Rather, they may Just be 
demonstrating what they already Imow and, possibly, the student teacher 
is not accomplishing enough new learning. Another area which migjit be 
misinterpreted by students is the negative association between 
*'explanation»need" and hi^ success rate (6-2 1)> For student teachers, the 
ability to give ■*expIanation-need" is especially important since their pre- 
planning dia^ostic and prescriptive skills are limited by lack of experi- 
ence. So, although a high level of explanation-need may reflect lack of 
planning for the experienced teacher, it may represent strong dia^ostic* 
prescriptive skills in the preservice student. Explanation-need is not 
used here as an instructional strate^ (6-23) to produce superior 
understanding^as it might be with experienced teachers— but is rather the 
result of a lack of experience. Failing to give explanation-need when 
appropriate may be a serious problem for student teachers. 

Rather than learning to emphasiie hi^ success rate, I think our 
students need more help in using the errors children make in the "moder- 
ate'' range to diagnose problems and to adjust instruction on the spot or in 
the future. They need help in providing children with enou^ practice to 
reach whatever their criterion of mastery may be, while keeping an appro^ 
priate balance with new learning for the group and for the individual 
children who have already achieved the mastery leveL It is toward these 
more complex areas, rather than toward a "high success rate"p^rs^, that 
our efforts as teacher educators should be directed. 

Group Work versus Individual Work 

At the end of the BTES report, we are told that "by keeping in mind 
the joint goal of student attention to appropriate task with a high success 
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rate, the teacher ean evaluata the currerit organizational structure and 
adapt it over time*' (43). The problem for the preservice student is that the 
"BTES model ean be thou^t of in terms of two general goals which are 
partly in confliet with eaeh other'' (40). The student is told on the one 
hand that greater substantive instructional interaction helps insure hi^er 
engagement and on the other hand that hi^ success rate is neeessa^. 
Given present adult-child ratios, engagement seems to be hi^er when 
students are in a poup setting because they get more ■^substantive instruc- 
tional interaction," Yet to ensure an appropriate success rate for all 
students in a large group is almost impossible. Then, contradictorily, we 
are told that the flfth^pade instruction was judged more appropriate (a 
rating which was positively related to achievemint) when the classes had 
an individualized program with a moderate success rate. And the authors 
comment, "'In sum, the proportion of high success rates seems to be a 
function of the type of classroom organization and/or what the teacher 
considers to be appropriate" (31). Clearly, these dilemmas demand further 
research before the neophyte attempts to implement the findings. 

If a balance between whole class, small group, and individual 
instruction and between moderate and high success rates is the desired 
compromise, then it should be stated up front with the substantive find* 
ings rather than in the back as a possible implication. The present contra^ 
dictions between the apparently deflnitive fmdings and the later qualiflca- 
tions are bound to cause confusion and skapticbm on the part of pre* 
service students. 

Academic versus Affective 

The polariEation of academic and affective orientation is not only miS' 
leading in terms of the actual BTES fmdinp, but also likely to alienate 
many preservice students whose motives for entering teaching often fall in 
the affective domain. 

ITie finding states, "Teacher orientation toward affect was negatively 
associated with academic achievement" (15), TOs is not as harsh a judg» 
ment apinst affective concerns as might be imapied at first reading. First 
of aU, the technical report summaty of this item reads, "Teacher orienta- 
tion toward affect to the exciuswn of academic instmction is negatively 
associated with academic learning*' (11=17), ITiis result is obvious. Addi- 
tionally, it does not necessarily follow, as BTES implies, that being 
"oriented to affect" was the reason these teachers devoted less time to 
academics (15)— they could be poorly organized or oriented to other sub- 
jects like social studies, science, art, and music. More seriously, one has to 
read the report to fmd out that the neptive correlation between affect 
and achievement nivar readies statistical signiflcance (7-19). 
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anothir eondusioii indicatis that concern for the affectivi laarning 
inviromnent may actually help academic achievement. "A learning 
enviromnint characterized by student responabillty for academic work 
and by cooperation on academic tasks was associatid with higher 
achievfment" (16). 

Dig^l into the unabiidged vemon softens the antiafTective charge 
even more. In talking about flexibility in the use of the curriculum, which 
was correlated ^th orientation to affectj we read: 

These tetters were Mncemed with whit the stud^ti Uked or weii 
Interested Th^ woi^ do tlu&p IDce ine the moft uiteiesting stories 
m the risder or extend a lesson if the student! were e^oying the 
discusdonu ^esumibly* theie tea^irs uied eafler miterjEl because diey 
^^tid students to lUce what they were doinf, (Data m diapter 9 sug^ 
pit they were right!) (MO). 

And the fifth^p^ade data reveal the importance of affective concerns to 



The flndinp presented in table 9=6 may indiaate that pide S students 
nact paiidviiy when the teicheri seem to pve them individual etten» 
tion. PiSth ^de student attitude chanp is posttMy cofrelated with 
enables mvolwg the teasers* affeeti^ and aKdends fe^inidon of 
thear individual n^ds and differencasp This is indi^ttd by the podtive 
correlations of residual attitude at pade J ^th orientation to^rd 
aHeet, propam ohanp^need^ item prediction, differentiated per» 
ceptions and appiopriatiness of currigulum for individuils, Howevirj 
pade 5 itudents may reaet negati^ly (m attitude) toward the teadier's 
coni^m for substantive a^dimie cimcuium per sa as distiniuiihed 
from the teadier*s conoem for the lelationMp betw^n the a^demic 
currieulum and student needs, ^lii would be indigated by the ne^tive 
correlation of fifth grade student attitude change with teadier a^detmc 
knowMp and competence. It is po^ble that flfth pade students react 
neptiveiy to teadtir a^demio kno\4edge and c<)mpetence when it 
reflects a peater teacher aon^rn for the substance of instruction than 
for the relationdup of the Mstruction to individual students. This could 
be related to negative student reaction to lack of individual attention 
from the teadieri Beu in mind, howeveri that these are tentati^ con» 
dufions based on liberal interpretations of the data (9^17)* 

And then in the last chapteri we discover that "almost aU second grade 
classes had a relatively hi^ degree of concern for affect'' (11-39). And the 
value judgrnents are clearly added in this concludini chapter: 

It sBeim reasonable to look for a middle ground. Many teadiers pve 
first priority to a^demic instruction but are also aware of student 
feelings and vali^ human development. The high^adiie^g pade 2 
daises ^ow this to some extent There are other good examples in 
both pades of teadieri who make a sin^re effort to pro^de com^tent 
a^demic mstruction and also take into account student intereits and 
human feeUniS, Often these classas are in the middle ranp of ALT 
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aid/or Echig\^mant. The conflicting dsmands of diffaient goals may 
tind to modmte ichiiveiaent demands. For many people this is an 
iC^ttble TOmpronuse* 

... In pads Sp the sample ii i whole was relativily more eon med 
mth a^demi^ No daises were as affective^ orientid as claM F. ome 
daMes were very strict mid excluflVily work oriented. In these clas^Sj 
flild woriceri tended to desaibe the atmosphere as "tense" or "uneom* 
fortable.-' These QlassiS tended to score wefl on adiievement tests, 
(^rhaps they were most thorou^y disdplmed to try hud on boring 
tijkSi) Some ^ople nu^t judfe the cost too ^eat, (11-39). 

Statements About Curriculum 

BTES has ixplieitly Umited tha scope of this study to ipeciflc teaching/ 
learning VEriables and has excluded goniideration of curriculum, limiting 
the scope of the study was necessary^ but to say that "curriculum is of less 
dirfCt importanci for teacher t mining'* (8-33) revaals a major misunder- 
standing about what we as preservice iducators are doing. Our students are 
struggling with both curriculurn and instruction concerns; to divorce the 
two and claim the primacy of one is inappropriate. 

Additionallys althou^ claiming not to address curriculumi the study 
includes several messages about curriculum which I would find disturbing 
if expressed by preservice students. For example: 

(1) It is interesting to note that ''curriciUum" (textbook series) 
has not represented a crucial variabli in our model of class- 
room laamlng (8-33). 

(2) For each pupUj a certain portion of the school day is set 
aside for work on decoding. This block (or blocks) of time 
constitutes the maximum time available for the student to 
work on decoding (2). 

(3) Typically, if ISO school days are mandated by the State 
Lepslature, about 30 days of regular instruction are usually 
lost due to field tripSs student illness, the Christmas play, etc. 
(9)- 

(4) ITie learning student spends a lot of time practicing and re- 
vievmig sldUs, He/she undertakes an activity related to a new 
skill only after thorou^y learning skUls prerequisite to the 
new sldUp so that he/die virtually never encounters an 
activity that is really entirely new (24). 

It is hoped that our students do not ^aduate equating curriculum with 
textbook series, ^locating sldll development to specific discrete times, 
overlooking the powerful leaming potentid in well-planned, integrated 
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fiild trips and plays, and abstracting principlei appropriate to sWU devel- 
opment to othf r Idndi of conGepliml, process, and affectiva learning out» 
comes. I am afraid that even thou^ BTES researchers do not deal 
explidtly ^th curriculuni, there is a particular model of curriculurn 
implicit in their diK^u^ions, Its desirabflity is debatable. 

Ftment Iinplications 

As a residt of my belief in the limited wion inherent in the study and 
the inconclusive natui^ of the findings, perhaps a leptimate response 
would be to postpone discussion of policy/program implications untfl 
further research is completed. But reality does not allow us that luxury. 
Reprdless of the study's Umitarions, there will be people who seek to 
implement the findings and there will be adimnistratorSi school boards, 
presSj teachers, student teacherSj and even some preser\ice educators who 
win respond in good faith. And, of course, there wiU be those representing 
a particiUar educational viewpoint who will leize upon the "evidence" as 
proof of their ri^tness. Hencej the major implication for us now is to 
make sure the dissemination and discussion of the findinp takes place in 
context-^with the limitations clearly understood and with the vdue judg» 
ments distinguidied from objective evidence. 

Although the BTES dm% not provide the "recipe," the identified 
ingredients are certainly useful, if not new, categories to help in talking 
about teaching. Wdle it would be surprising if there were more than a few 
preservice educators who do not already accept the importance of the 
teaching process variables (diagnosis, preicriptionj presentation, moni» 
toring, feedback) or the classroom learning variables (time allocated to 
taskj attention p appropriate level of instruction), their appearance here 
gives us all a diance to evaluate our own program's attention to these 
variables— not to the exclusion of others and not necessarily with the 
prescriptions offered here (Le., high success rate), but as manifested in the 
context of our view of teaching/Ieaming in the elementary school. 

In revievsdng how our propams help students achieve an understanding 
of such variablis, perhaps we wiU find that there are certain areas which 
need more attention. In li^t of the recent national survey of teacher 
education pro-ams (Joyce, 1977), I would suspect that "diapiosing di- 
verse student needs" will be an area needing improvement. But the same 
study also shows us that these variables cannot be used as the only or the 
most important checklist in internal evaluation of preservice programs. 
The two other areas which faculty and students think need improving 
would be overiooked: '^understanding legal, political and organizationai 
structure of schooling" and "working with both economically disadvan- 
taged and multiethnic constituencies" (Howey, 1978, p. 39). 
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In diseussions with students, the BTES wili also be useful in providing 
concrete illustrations of the dilemmas and the complexity of teaching, 
which go beyond the superficial clarity of the flndinp. TTie study clearly 
demonstrates that teachers need to strung to find the appropriate balance 
bitween conflicting forces within the context of their own goals, the 
community's expectations, and the needs of the specific learners. The 
teacher's dilemma is to find a balance between such factors as: 

• Hi|h and moderate success rate 

• Whole class, small group, individual instruction 

• Time allocated to different subject matter goals 

• Cognitive and affective concerns 

• Coverage and mastery 

^ Teacher decisions, joint decisions, child decisions 

© Absolute attention and realistic inattention 

• Standardized criteria of evaluation and idiosyncratic criteria 

• Needs of individuals and needs of the group 

Even when explicitly considered, the BTES study does not provide the 
answers to these dUemmas, but it does serve to make their presence more 
apparent. Teachers make decisions about these dilemmas all the time— how 
and why would be interesting material to discuss with preservice students. 
If these decisions are not viewed as conscious ones, based on knowledge, 
intuition, and values, then beginning teachers will quickly fall into com* 
fortable habits and not have the self-analytic skills they need to improve 
their own- teaching* 

Besides these general implications, I find it hard not to grasp onto 
particular ^'tidbits" which would be useful to share with preservice 
students. Obviously, everyone's selection list will reflect her or his own 
biases and will also present difficulties with preservice students and co- 
operating teachers' classrooms. Here's mine: 

L The importance of teacher-student interaction in contrast to an 
overly self-paced environment. 

2. The positive relationship between student responsibility/ 
cooperation and academic achievement, 

3. The positive relationship between the percentage of other-paced 
instructional time and engagement during seatwork. 

4. Hie negative relationship between task engagement feedback 
(usually yelling) and achievement. 

5. The presence of some type of positive reward system in the high" 
achieving second-grade classes Ln the descriptive sample. (Bionic 
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handdiakei and praise take precedence in my mind but not pre- 
cluding tee cream cones and tokens for prizes when the circum- 
stances demand it,) 
Because of the aforementioned linaited ^ion iriierent in the study and 
inconcludve nature of the findings, I feel the present implications for 
preservice educators are limited to maWng sure BTES is discussed in con- 
text ; intenial teyitvmg of pro^m m relation to the BTES variables in 
view of one's own wsion of teaching^eanung in the elementary school; 
md dBcusdng some selected flndinp whidi may address present concerns. 

Gantral Implications: When and If tiie Knowledga 
Ba^ Is Strengtfiened 

Wien and if the relationdiip between the BTES model and adiievement 
is established m more condusive mi generalizable to a wider range of 
students, and more descriptive data on how teachers make the decisions 
implicit in the model are avaflable, tfien the implications take on another 
dimen^on-^possible changes in preserdce cctursework, student teaching, 
and certification procedures. 

Of course, no matter how strong the empirical support for BTES, it 
woidd stfll represent only part of the teachiiig/leaming taking place in 
elementary school classrooms. How much emphasis should be placed on 
this type of learning remains a vdue decision regardless of the strength of 
the evidence p 

And even if ma and reatog achievement as measured by standardiEed 
tests is apeed to be a major go^ of elementary schooling, the teaching and 
classroom learning variables represented in the BTES model would form 
only a part of the taiowledge, sldls, and attitudes essential for ttiose 
preparing themselves for ilementaty sdiool teadiing. BTES does not 
examine other components of teaching siwh as subject matter knowledge, 
cWld development, observation sldlls, curriculum development, manage- 
ment and disci^esldls, development of positive cla^room environment, 
quality of instroction (rariables other thwi those in the BTES model, such 
m variety of teaching stratepes, questioning tedmiques, motivation), 
problem^iOlving sldlls, self-critiquing sldlls, and professional development. 
Hence, BTES would take its place as one part of the preservice curriculum, 
with priorities being established vwtiun tiie context of each propam's 
gods. Even if consensus were posdble, it is of cpiestionable desirabflity in 
light of our pluralistic approadi to schooling. 

And it is clear that BTES can serve only as context and not as a model 
for teaching presendce students, because our outcomes are far more com- 
plex than Increadng achievement scores in rea<tog and math. And the 
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nature of teaching precludes a "high success rate" in leaming how to 
tiach. Leamini from one's irrors is a better mindset than trymg to re= 
spond making minimal errors, because teaching is too complex to expect 
perfect performance, and risk-taldng and experimenting are critiiral vari'- 
ables for profissional growth. Hence, we should teach using BTES as the 
model oiyy when our outcomes are similar to those evaluated on math and 
reading tests. 

Thus, the process of incorporating a validated BTES model into a pre- 
service program would essentially be the same as incorporating any n? v 
content into the curriculum. The necessary changes would depend upon 
the existing program. Resulting programs would differ in emphasis, form, 
and evaluation of the students' unde^tanding of the BTES model' Some 
elementi would lend themselves to micro or peer teaching (Le„ teaching 
process variables) and some to discussion (i.e., value judgments about 
balancing conflicting demands, how experienced teachers make judg^ 
ments). But most of these understandings would have to be developed in 
actual classrooms with adequate supervision from university faculty and 
the cooperating teachei^, all familiar with the BTES model and capable of 
using it. 12 If competence according to the BTES model were considered 
important enough, supervisors and cooperating teachers could use observa* 
tional schedules to evduate a student teacher*s performance as was done in 
the study. Student teachers would also need to be given the means to 
analyze themselves along these dimensions. 

Wiether competence in the BTES model should be used as part of the 
criteria for evaluating student teachers would be another institutional de* 
cision. If so, this demonstration should take place in the context of the 
complex teaching situation and not the college classroom, because demon- 
strating skills in isolation may not be related to ''making the whole thing 
work." If this assessment is going to have any predictive validity for full- 
time teaching, student teachers need to be ^ven an opportunity for total 
responsibility for a class for an extended period of time. 

If a set of competencies were to be mandated by the State, I think it 
would make more sense to include them as part of permanent certification 
rather than as graduation requirements. Since competence is dependent on 
context and experience, and a realistic aim of preservice programs is to 



l^obviousiy, a most influintial factor would be plaoemint with a coopirating 
teadier who was a "master BTES tiadier." But I would use BTES competence as a 
criterion for cheesing cnly one plai^mint for the student teacher-the other would 
be with a different Wnd of master teacher, a "reality*' plawment or one meetini the 
particular nmds of the student. 
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produce "moderately effectiva** teachere (McDonald^ 1978), demonstra- 
tion of competencies diould take place after the student teacher is em- 
ployed as a teacher* Permanent certiflcation some time within the first 3 
years of actual classroom teaching would aUow for a more vdid a^essment 
as well as putting some teeth into the certification process. Unlike the 
present arrangements, permanent certiflcation would be contingent on per* 
fonnance on the job rather than on perseverance In coursework. 

State investment in the continuing education of probationary teacher 
would probably ^eld a higher return than most tradition^ inservice work. 
Linldng beginning teachers ^th university and school insendce educators 
could do much to break down the Umiting barrier between preser\1ce and 
inservice education and between university-based and school-based teacher 
educators, both of whom bring important different perspectives. Evetyone 
(teadier, education fac^ty, local school) would be ^sponsible for facilita- 
ting movement to\^rd "highly effective teaching status.** Other already 
permanently certified teachers who wanted to work with student teachers 
could be certified as "master teachers" when they demonstrated the 
requisite competencies. 

Obviously, I believe we are a lo^ig way from being able to implement 
the implications discussed here, either for BTES or for a more general set 
of competencies* IRie knowledge base establishing what competencies are 
essential and generic is not strong enou^; nor have we begun to tackle the 
valued aden issues involved in a mandated plan^-maintaining the balance 
between ensuring a level of competence and allowing a healthy diversity, 

Surnmary 

As a basis for discussion, I have focused on underlying assumptions that 
raise questions about the usefulness of the BT£S flndirigs for teacher 
educators, problems in the presentation of the findings which may be 
particularly troublesome for preservice educatore, present implications, 
and implications for the future, when and if the Imowledge base is 
strengthened, Regardleis of jn^eservice educatori' feelings about the sub- 
itantive findings of BTES, it is evident that there is much to talk about 
here— issues which will continually face us as preservice educators. It is our 
obligation I as it is in our interest, to make sure that these issues do not pt 
lost in overly simplistic interpretation and inappropriate implementation. 
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BTES: Implications 
for Staff Development 

Lynm Miller 

I approach the BTES fmdinp as one who has been favolved in the 
practice of teaching for lome timej first as a tiachir in urban secondary 
schools and more recentiy as one who worla with teachen in staff 
development efforts in a variety of settinp. My initial responie to the 
BTES research can best be described as tentatively positive in tems of 
what it has to offer to staff development practitioners, Uke all research, 
BTES presents data and theory abstracted from data which may be inter- 
preted and used in any number of ways. Depending on the assumptloni 
and habits of those entrusted with policymaldng and staff development 
actiidtiesj BTES could become eitiier a force for the further reiflcation of a 
narrow view of teaching improvement or an entry point for a careful 
eonsideration of the process of teaching and learning, leading to sipiflcant 
professional development* Let me elaborate on this point by drawdng two 
distinctions about the ways in which teachers and teacher development are 
discussed in the research and in practice, 

Ilie first distinction rd Uke to make is between a view of teachers-as- 
objects and a view of teachers-as-subjects. Since the Sputnik crisis in 1957, 
there has been widespread acceptance of the belief that teachers are targets 
for improvement and that tiiis improvement can be brought about by the 
delivery of services, Wiettier Aeie services are the upgrading of subject 
matter knowledge by univerdty faculties or training in specific compe- 
tencies by educationalists qua technicians, they have been Imposed on 
teachers by authorities from outside the world of public schools. Teachers, 
when viewed as the recipients of the goods and service of outside expertSj 
flinction merely as the objects for others* intentions and actions rather 
tfian as the initiator of their own development and ^owth. Such an 
approach has led to the creation of "teaser-proof 'curriculums for schools 
and the development of beha\dor-specific training packages for teachers. 
The net result of this approach has been the failure to implement improve- 
ments intended for the schools, the development of teacher skepticism 
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about the uMfuIness of research and the competence of academicians and 
consultants to apply theory to practicCj and the heightening of teachers' 
resistance to any prograins aimed at their "improvement." Sarason (1972) 
and others have illustrated the futility of reform efforts which view 
teachers as objects; yet this approach persists and often predominates in 
the literature and in the field. 

The other way to view teachers^ of course, is as subjects, as active 
participants in their own professional development. Hie Rand Change 
Agent Study (1973-77) indicates that new policies are implemented and 
that new behaviors and procedures are instituted only when there is a 
process of "mutual adaptation/* Mutual adaptation assumes that teachers 
are subjects who are engaged with other subjects in activities of assess- 
ment, trial, modification, retrial, implementation, and evaluation around 
issues of materials, organization, and instruction. This approach has led to 
some of the successes enjoyed by the open education movement and has 
provided the framework for the development of teachers' centers, where 
teachers are taking charge of their own professional learning. Unfor- 
tunately, until recently this view of the teacher-as-subJect has been a 
minority position in circles where policy is made. It is heartening to see an 
increasing awareness of the importance of a decisionmaking role for 
teachers, as is evidenced by the earlier chapter by Gary Fenstermacher. 

The second distinction 1 want to make in my discussion of how the 
BTES research may be interpreted and used is^he distinction between 
inservice and staff development. Traditionally the preparation and ongoing 
education of teachers have formed two components of "teacher educa- 
tion": preserviQe and inser\ice. Both components function under the 
authority of universities or teacher-training colleges, Inservice teacher edu- 
cation has come to be characterized by a focus on individual teachers who 
are viewed as "students" or "trainees" and who throu^ their participation 
in academic course work and issue-specific workshops earn credits toward 
advanced degrees or salary increments. For many teachers, "in-service has 
failed out of irrelevance, diffusion, haphazardness, and superficiality" 
(Leiter and Cooper, 1978, p, 108). 

The notion of staff development, on the other hand, provides a differ- 
ent, richer, and more complex approach to professional education for 
teachers. 

We chooM the term siaff deveiopmeni instead of in-servi^ or teacher 
education/training beeausc it luggests a different approach to improve- 
ment, one that consideri the effects of the whole ichool (the staff) on 
the individual (the teacher) and the necesdty of long term growth 
possibility (development). We reject the idea of gi^dng courses and 
workshops to individual teachers in isolation from their peers and the 
ichooL We further reject the notion that teachers can be "taught" or 
**trained" to be better teachers by the mastery of medianlcal behaviors 
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outddt the ^ntixt of theory and practi^* Wa aecept and axplori 
furthir Uie fiet that developmint maani woikhli with at Iiast a portion 
of the staff over a period of time with tti neeemiy sypportive eendt 
tioni (Ueb^man and MUliri 1979), 

Hiat is, staff devdopmsnt concgntrates on (l)thi individual teacher as 
part of (2) the intire school staff engaged in (3) development activities 
that take place (4) over time* 

Given Aese distinctions about teachers and teacher development, it 
should come as no sui^rise to the reader to learn where my own biases lie. 
I view myself as someone who is involved in staff development^ not in- 
sendee, and as someone who accepts ttie teacher-as-subject as part of my 
working ideolo©^* With that framework as my point of departurep I can 
well imapne uang the BTES findinp as part of my work vwth teachers in 
schools. Unhappily but not unpredictablyi I can also imagine other 
piople-with other assumptions and values-using BTES for different ends 
and in different ways* If, as M* Frances Wiin suggests in her chapter, it is a 
behaviorist construction that most underlies the BTES research, then 
BTES may become yet another vehicle for the reduction of specific objee- 
tiveSj the prescription of discrete behaviors^ and tiie generation of new 
fonm of accountability which undermine the autiiority of teacher as an 
individual and of teachers as a coUeetive force in education. If that is the 
easCi then I am quite sure that BTES will contribute nothing to current 
efforts to improve schools throu^ improving teaching. 

Ifj however^ we view the findings throu^ the lenses I propose, I believe 
that we can fmd much of value and usefulness that the research con- 
tributes to staff developers, sdiool improveiSj and teadiers. Below I note 
thr^ useftil contributions that BTES makes to staff development efforts. 

First and most importanti BTES provides informarion that ^timately 
Unld teaching practices to student achievement outcomes. Such informa- 
tion can be extremely useM for a staff developer who is dways dealing 
with the problems endemic to the teaching profession-among them the 
weak knowledge base, the uncertain teaching Mid learning links* and the 
va^eness of goals (Lieberman and Miller, 1978). Altiiou^ BTES by no 
means provides the solutions to these problemSj it does provide some clues 
about the process of teaching and learning under speciflc conditions. These 
clues may be used to unlock some of die blockages to learning that inhere 
in teachers* classrooms. By articdating linkages for teachers and by 
guiding their attention to some of the variables that affect student achieve- 
ment, the BTES-informed staff developer can help to temper some of the 
"endemic uncertainties" (Lortie, 1975) of the teaching task and can help 
tethers to gain a sense of penonal efflcacy about their work. Such a sense 
is the prime motivation for involvement in profession^ develo^ent 
activities O^cLau^n md Marsh, 1978) and is an essential ingredient in 
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growth of a faiUng of proftsdondiim. In i long-rangi peripictivi, one 
of the goals for staff devilopniint ii to upgrade the profession of teaching 
in gfniril, Tlie sldUf^ staff develop er can uie the BTES flndin^ as a 
valuable means to thta end. 

Seaondp study actoowledges the complixity of teaghing as an 
activity* This penpiGtive on teaching is essential for staff developers to caU 
on in support of their efforts to upgrade the profession. An underitanding 
of the complexity of tea^ng hdps to dignify the profeidonj not under* 
mini it as do more simple formulations. If teaching is viewed as more than 
a matter of mastering a recipe book of expert-prescribed practices, then it 
becomes a creative and inteUectudly chiUen^g undertaldng. By focusing 
on these aspect of teachings staff devdopers and teachers can move away 
from the "make and take" mentality mth its emphasis of "hands-on" 
experienoes wluch tends to donwnate in staff development practice at the 
present moment We can raAer embark on an exploration of Issues and 
concerns which ai^ theoretic^ as weU as practical* Teaching then becomes 
an inteUectuM pUE^e that has many po^ible solurionsj requiring many and 
varied inputs and approaches* We cm encourage trid and enor mther than 
replication, problem sol^g rather than mechanical imitation. Such an 
approach acknowledges the clinical expertise of the teadier and dlows for 
tfie collaboration of staff developed and teacher on the project of im- 
proving practice. 

Finally^ BTES prowdes some useful tools for opening isauei and render- 
ing insists about teadung and learning, about classrooms and students. 
T^e study provides a vocabulao^ for describing and asses^g instruction, a 
mirror of sorts that staff developers and teadiers can hold up to practice 
and use as they evaluate their work* For me, the issues and insists that 
BTES raises cluster around notions of timej structure^ and process. In the 
pages that foUow I shaU explore these notions further and discuss their 
implications for staff development. 

Time 

The notion of time is central to the BTES flndinp. In the vocabulary of 
the study, Acadenyc Learning Time is the key phrase for conceptualizing 
the structure and uses of time in classrooms. More speciflcallyj ALT in- 
volves considerations of time allocation, time on task, or engapment, and 
succe^ rate. ALT prowdes a very concrete formulation of what is a very 
abstract notion. Such a fonnulation has its advantages for tiie staff 
developer. 

I can imagine staff development programs that enpge teachers in moni- 
toring how time is aUocated and used within their own classrooms. Such 
self-monitoring is not difflcult to desi^ when it draws on the resources of 
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tgaehiri and the pinpicti^^s and skills of staff diVilopirs. After an initial 
look at how the ALT ^riablis ara at work in their Qlassrooms, teachers 
n^ay bepn to make modifications in the ways they dlocate and use time, 
'^ey may feel more in control of their classrooms when they -learn to 
manipiJate their time constraints more purposefully* M^t is particularly 
attractive about the Idnds of activities imapned here is that they enpge 
teachers in analyses of their own situations and experiencesj they help 
teachers develop solutions within a specific context, and they allow staff 
developers to participate along \rith teachers as describers rather than 
prescrlbers, I would think that for each classroom and for each teacher a 
different analysla and a different modification would emerge* In this way, 
each teacher would have considerable control over his/her own staff 
development. 

Thus far in my discussion of time, I have focused on the advantages of 
the concrete notion of time that ALT offen for staff development. But 
there is more to the notion of time in claisrooms than ALT dlows us to 
see. Anyone who has worked in public schools knows that time controls 
teachers at least as often as it is controlled by them. The vety orpnization 
of schools places enormous constraints on the uses of time in indi^dual 
classrodms. Teachers must continually adapt to the demands of super- 
visors, the regularities and routines of the buUding, the eternal inter- 
ruptions from the outside, and the attention to details that internal main- 
tenance requires. In addition, there are the ''rhythms" of teaching (Lieber- 
man and Miller, 1978)-the pidse of the classroom^ the psychic routines, 
md the energy levels-that sem to deflne the interactions between 
teachers and students, between instruction and learning, and between 
teachers and tiieir wotk. ALT to not a useful concept when applied to 
these notions of time. In fact, ALT does not acknowledp the existence or 
the power of time when it is viewed in these ways. 

'^e above discussion is presented' as a caution to staff developeii who 
may be so attracted by the simplicity and concreteness of ALT as to 
overlook the complexities of time as it controls and is controUed in class- 
rooms. When ALT is accepted as one smaU clue in unraveling the puzzle of 
teaching and learning, it is indeed useful. When it is seen as more than that, 
it is impractical, 

Structure 

Deriving from the notion of time is the notion of structure* I view 
structure as the purposeful ordering or placement of people, materids, and 
resources in time. In the vocabulary of BTES, this notion is encompassed 
in the key phrase "setting." On one level, setting can be analyzed and 
modifled in ways that are simple and direct. Working on this level, the 
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staff developer may pose some questions s/he is prepared to explore with 
teaehers, Hiese queitioni may involve the issues of concrete time I have 
just deviloped, as well as issues invol^ng people and materials/resources. 

For instance, in regard to concrete time, we may pose the following 
quastioni: How much time is spent in academic subject areas? How much 
time is spent in other acti^dties? How much time is spent in making transi- 
tions? In maintenance? How much time is spent in diapiosing student 
needs? How much time is spent in feedback activities? In regard to people, 
we may ask.' How are people organized for learning? In groups? As individ- 
uals engaged in seatwork? At random? In a large group? What is the 
teacher's portion vis-a-vis students in the classroom? Tranimitter? Facilita- 
tor? Lecturer? Erection giver? Direct instructor? Supporter? Critic? Who 
makes what decisions about instruction? About sequence? About 
routines? In regard to materials, the following questions come to mind: 
How many instructional altematives exist for any one task? At any one 
time? For whidi students? How are materials developed? How are they 
used? How is appropriateness determined? How is mastery judged? How 
are materials evaluated for use and usefulness? Wio develops materids and 
how? As whan I discussed the applicability of ALT, it is easy to imagine a 
set of monitoring activities that staff developers and teachen mi^t design 
around these and similar questions, Apin, a major contribution of BTES 
to staff development practice is that it provides a concrete framework 
which generates useful questions, questions that can be answered by the 
manipulation of people, materialSj and resources in time* 

The problem >^th using BTES in this way is that the questions it raises 
serve to uncover many of the complexities and difficulties about teaching 
that are most debilitating to confront. In considering the implications of 
structural concems, 

tha teaehef must take into iccount the diveriity of the class, devise 
some workable oriamEational system, i^lnf different settinp (iroup' 
work, seatwork) for diffeiint itudents in different eontant areas at 
different times during the sdiool day, and keep the whole system 
adaptable to some extent as student needs chanp during the school 
year (Filby, 1978, p/j). 

IHiat is a difficult order to flU, It requires a major restructuring of the 
classroom and a major reassessment of the teacher role, a role that most 
practitioners have worked long and hard to define for themselves. TTiis 
raises staff development to another level of difficult y, Wien presented 
^dth such a scenario, teachers will need a ^eat deal of support to resist the 
temptation to retreat into the familiarity of old routines. 

The staff developer who sees potential in BTES for staff development 
efforts must well appreciate the enormity of the task ahead. As was the 
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caaa in applying ALT to clissrooms, what sagms simple mi concrete takes 
on new compliJdty when confronted by practice* Staff development has 
to taka place on any number of levels: concrete and abitract, immediate 
and long-range, practical and ^dsionao^. It is also important to acknowledge 
here apin that, in many ways, teachers are controlled by structure, rather 
than controlling it; tMs fact can greatly affect the efficacy of our staff 
development efforts, I diaU return to this point in the concluding section 
of this chapter. 



Related to notions of time and structure is the notion of process, a 
concern for meins often independent of a concern for ends. In the vocabu^ 
lary of BTES, process is encapsiUated in the key phrase "interactive 
teaching behaviors/^ \^at is important in this notion, I thinkj is the focus 
on the interdependence of behaviors- Mifle the interactive behaviors tMt 
the study identiflas (dia^odSj prescription, presentation, monitoring, and 
feedback) are hardly new or earth^Aattering, they do direct our attention 
to the teaching act as something more than the compilaUon of discrete 
behaviors. TTie interactive behavioii identifled may be of use to staff 
developer who tre committed to illuminating the intricacies of teaching 
for teachers* They may be viewed as descriptors of aspects of teaching, 
providing useful feedback for teachers. 

*nie implications of the process notion for staff development go beyond 
the level of the teacher and the classroom, TTiey touch the level of the 
staff developer as s/he is enpged in his^er own work* I ^ew staff develop- 
ment as a teadiing acti\dty concerned with the professional leaming of 
teachers* As teadiers, we staff developers may apply BTES notions to the 
illumination of our own work. Our behaviors, like those of teadiers, are 
interactive and depend on the degree to which we control our own time 
and structure. We may ask: How do we assess teachers' needs? How do we 
develop prescriptions for our behaviore? How do we present new informa- 
tion? How do we monitor how our assistance is being received? How do 
we provide for feedback for ourselves? 'Hie depee to wWdi we attend to 
our own behavlon may weU be the degree to which we experience success 
in our work. By accepting the value of process, we do much to counter- 
balance the emphasis on product that staff development too often 
connotes to teacheri. 

I find the notions of time, structure, and process (expressed as "ALT," 
"setting," and "interactive teaching behaviors" in BTES) valuable contribu- 
tions to staff development on a ^riety of levels. ^ one level I value these 
constructs in that they are simple and strai^t forward ^ys to be^ dis- 
cubing aspects of teaching and leaming. On another level I value them 
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because they provide some guiding principles for the work of the staff 
developer. On yet another level I value them beeause when considered in 
the li^t of the realities of teachings they expose ve^ clearly the diicon- 
tinuitiei between research and practice. Vd like to elaborate on this last 
point. 

One of the chamcteristics of research is that it limits its field of ^sion 
to a small portion of the variables in any gjven situation. When research 
findings are applied to practicep an inevitable problem arises from the 
incon^uity of the conditions of the research and the conditions of the 
social setting to which it is being applied. The very variables that have been 
excluded from the research are those that are most problematic in 
practice. There are "missing links' -or what I term discontinuities- 
between research and practice. It is incumbent on the staff developer to 
flU in those missing linksp to make the movement from research to practice 
more continuous. 

In the case of BTES, the field of vision is limited to individual teachers 
in individual classes teaching a predetermined set of sldlls over a limited 
period of time. 'Hiis obvioudy leaves many discontinuities for the staff 
developer to address. I want to concentrate on one of these here; that is, 
the discontinuity between a focus on the individual teacher and the social 
and political context in which sAie is situated. Although the BTES re- 
search focuses only on the level of the teacher in his^er classroom, good 
staff development practice dictates that we tend also to the school as an 
institution and as part of a larger political system. My earlier discussions of 
the notions of time and structure also indicated the need to deal with 
issues outside the control of the teacher in his^ier class. 

In the discussion that follows I want to focus on three levels of con- 
cern: individual^ ofganizationali and politieah The purpose of this dis- 
cussion is to pro\1de a framework for the ways in which a staff developer 
mi^t work in addressing the dfecontinuities that inhere in the BTES flnd- 
ings when they are applied to practice. 

The Individual 

"nie most powerful implication of any research when applied to prac- 
tice is that individuals must change their current ways of operating. As 
noted prewusly, the BTES findings indicate that a change is required in 
the ways that time and structure are used in classroomi. For the individual 
teacher this is a challenge to existing routines which, if not always effec- 
tive, are at least comfortable. In the past 5 years, some ^^luable work has 
been done in uncovering how teachers adapt to required changes and how 
staff development can help in the process of adaptation. More specificallyj 
we now have the following understandings about this process: 
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L Individual taachii^ adapt to changi devdopmentaUy; "change 
takes time is adueved in steps" (Hdl and Louoks, 1978). 

2. Individud teacha^ are motivated by a sense of personal efTicacy 
in adapting naw procedures in their classrooms (McLau^in and 
Marsh, 1978), 

3, Staff developmfnt Is effective in hilping teachers adapt to diange 
when it provides training and support activities which are largely 
planned by the teachers themselves (Mcl^u^ilin and Marsh, 
1978). 

TTiese undentandings provide u^ful guidelines for staff developers who 
are working to bridp the gaps between research and practice about 
student learntag and cla^room instruction* 

aearly the task of tiie staff developer is to hdp teadiers take the 
necessary steps, one by one, which wiU enable them to modify their class- 
room procedures and practices without risking their sense of control and 
personal efficacy. This task requires that the staff developer be present in 
Ae teachers' classroom and become engaged in the lives of teachers on a 
regular and frequent basis. By being consistentiy present, the staff 
devdoper may function as an extra and helping set of eyes, ea^, and hands 
In the classroom-working alonpide the teacher as s^e takes the first steps 
toward reordering existing procedures and routines. In addition, by being 
present, the staff developer is in a position to pro^dde trusted feedback 
about student propess and adilevement, taking care to call attention to 
the ways in which new teacher practices are concretely benefiting 
students. The staff developer's presence : . the primary support 

activity that cm be provided; it is a neces- complement to any initial 
training which introduces new data about leaching and learning- Presence 
is the inpedient that makes new information, often viewed as abstract and 
remote, become practical and immediate* 

Th§ role of the staff developer must always be secondao^ to that of the 
teacher; that is, the staff devdoper takes his/her cues from the individual 
teacher with whom s/he Is working, ^ii does not mean that the staff 
developer always acts in a reactive way; indeed, an important function of 
the staff developer is to provide intellectual stimulation and professional 
challenge to the teadier. What it does mean is that once the chaUenge is 
made and the stimidation provided, it is the teadier who ultimately de- 
cides what seems most promising for the improvement of Wilier own 
sdtuation. Tlie teadier, then, sets tiie task; the staff developer rids in 
implementation* In another essay, Ann Uebennan and I (1978, p. 67) 
state that a staff developer must 

lavi idMi thit m pripiant with posMbflltiei, related to what teadiers 
i§e mtan^gftd md doahls pven the rtal ^nstriintf of tinti, mmgy, , 
ind the d^ineii of idiooL 
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I think that BTES presants ideas that are "pragnant with possibilities," 
with Important implications for use in staff development* l^e role of the 
staff developer is to provide access to those ideas for teachers and to work 
collaboratively to explore the possibilities and to help transform the possi- 
ble into the real. 

TTie Organization 

Although it is often obvioui that new information provides the impetus 
for individual chanp, it is not so obvious that change is required on 
institutional levels as well. I want to argue that without an institutional 
commitment to improvement and change, individual efforts do not have 
much promise for success. As a case in point, let's look at the notion of 
structure again. Structure exists on many levils. 'Diere is, of course, the 
structure of the individual classroom, which, as noted above, can be 
changed to accommodate new Information about the structure of the 
individual school This includes the overt structure of activities, settinp, 
and schedules and the latent or hidden structure of the informal rules, 
conventions, norms, and expectations that define acceptable behavior and 
set limits to new behaviors. Wien a teacher tries something new which 
involves a change in classroom structure, s/he has to be careful that the 
change does not violate the latent structure of the school in which s^e is 
situated. TTiis places boundaries on what teachere are willing to tTy. In 
addition, teachers may find that the change they want to make challenges 
the overt structure of the school-timetables or space aUocations, for ex- 
ample. Such a change becomes impossible in an inflexible and change- 
resistant school structure. 

The implications for staff development are obvious: the whole school 
must become a focus for staff development activities if the goal is to 
influence time, structure, and process. As in the focus on individuals, 
current understandings about the institutional or organizational level may 
guide our work. They are: 

L V/hBTi the school is viewed as the unJt for change, it is possible to 
link individual improvement activities to programmatic concerns 
(Goodlad, 1975; McLaughlin and Marsh, 1978). 

2. like individuals, schools adapt to change developmentally-in 
steps (Bentzan, 1974). 

3, TTie principal is the key person in making a school open to and 
supportive of new procedures and behaviors (Goodlad, 1974; 
McLaughlin and Marsh, 1978). 

Staff development must be multifaceted; it must focus on the principal 
and the total school as an organization, 
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For the staff diveloptr, this means that Wi/her \dslon must reach be- 
yond the classroom the teacher, that the notion of preience means 
being present in tiie total Ufe of the sdiooL Thgt is, the staff devdoper 
must learn the replaritiei of the individual sdiool, how people live and 
teach in thek sahool en\dronment. S/he must become embedded in the 
daUineis of the school and learn the points in which interventioni are 
possible on an orpniEational leveL S^e must see her/himself as working 
i^th prindpals as well as teachers, as involving the whole school as an 
mtegrated community in the project of staff development. 

The focus of staff devdopment may then become the improvement of a 
total sdiool program. It is important to recopdze that the relationship 
between teacher development md schooMde development is interdepen- 
dent and dynamic^ that one affects the other, "niose who are concerned 
with the notions of time, structure^ and process that BTES raises must pay 
partic^ar attention to organisational as well as individual iisues, Tliese 
isiues provide some of the "mis^g links'' between researdi and its appli- 
cation to practice. 

Political 

Education is political. It is important to lecopiiie that any research and 
any poUoy that result from research are viewed in deeply political terms by 
school people. Given this assumption^ BTES has political sipiflcance. This 
is so because it involves a \^riety of actors and institutions with a variety 
of interests. To be more specific, BTES is the product of research fmided 
by public monies with the intention of uncovering infomiation about 
teadiing and learning which can add to our existing knowledge and can 
ultimately influence practice. Accepting this as the raison d'etre for BTESj 
we admit the foUo^^g interest groups' professional researchers, the 
Federd Government^ State level disseminators, district level administra- 
tors, boards of education, teachers as individuals, teacher associations and 
unions, and chUdren and their paj^nts, Richard WUUams notes ^e implica- 
tions of this collection* of uiterest poups for staff development when he 
says: 

A p^tial explanation of om Minmig mabiUty to laundi effietive ftaff 
developtnint agtiMties li€s in thi fact that the varioul parties who are 
ingagid in the ded^ing, pro^dlngi and receiving of sti^f di^lopmint 
often, in spit^ of their public utt^ances to the ^ntrary beha^ in mys 
that are at least as responsive to their own selMntareiti as they are to 
thetf offldal positions reprding what constitutis a dedrable div^iop- 
ment program (1978, p, 96), 

Undesirable as it mi^t be, staff development itself becomes politick when 
It involves the range and variety of inte^st groups that are involved in 
FTES. 
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What does this imply for ths staff developer? First, it means that the 
staff developer must be willing to involve him/herself politically as a nego- 
tiator between and an advocate within specific interest groups. Secondly^ 
it means that the staff developer must learn to e^^luate the political 
climate as weU as the climate of indi^dual schools and individual class- 
rooms. Finally, it means that the staff developer must function as a 
"loner'' of sorts^ someone who is not too closely identifled mth any one 
interest group. Viewed this way, staff development is a very lonely 
profession* 

iliis discussion has focused on one of the discontinuities between the 
conditions of the BTES research and the social facts of schools and class- 
rooms; that is, the discontinuity between a imm on the individual teacher 
and the fact that indi\1duds work in a context bounded by institutional 
concerns. I think that the discu^ion has been fruitful in uncovering some 
of the implications for staff development that BTES raises. Equally fruit- 
ful, I think, would be explorations of (l)the discontinuity between a 
focus on basic skill development and the fact of the school curriculum and 
(2) the discontinuity between the focus on academic adiievement and the 
fact of the interaction of affective and academic domains in a classroom. 
Such conaderations would help to define the "missing links" between 
research and applicaUon to practice, which is the domain of staff 
development* 

Summary and Conclusions 

In this chapter I have considered the BTES flndinp in light of their 
implications for staff development. Establishing as my starting point a 
\dew of teachers-as-subjects and of staff development as a nonprescriptivi 
activity, I identifled some of the contributions that BTES may make to 
practice. I noted that what I find mose useful in BTES are the tools it 
prondes for opening issues and rendering insists about the teaching and 
learning process, TTie research offers a lens through which we may view the 
activities of teachers and students in classrooms* By illuminating the com- 
plejdties of practice, BTES can be used to help make staff development a 
relevant and intellectually engaging enterprise. 

In addition, I noted the limitations of the BTES research and its appli- 
cability to the real world of public schools. Specifically, I discussed the 
discontinuities between research and practice. By so doing, I was able to 
stake out the territory of the staff developer— the "no man's land** be- 
tween the conditions of research and the social realities of classrooms^ 

I think it is fair to say that a careful reading of the BTES flndinp 
exposes some of th^ complexity, the difficulty, and the exciting promise 
of staff development enterprises, I would also condude that, ^ven a 
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^ieific vdui itinee and a eoneim for diapining— rather tiian simplifying— 
undf rstandinp about praetica^ BTES has some important implications for 
staff devalopers. 
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Implementing Practices in 
Elementary Schools Based 
on BTES: Implications for 
the Principal 
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ITie purpose of this chapter is to explore the role of the principal in 
impiemendng successful practices based on the findings of the Beginning 
Teacher Evaluation Study (BTES)^ In elemintary school classrooms. 

On first reading the BTES, one mi^t reasonably assume that it has very 
little to do with principals. I^ie study discusses such topics as Academic 
Learning Time, classroom en\dronmentj pupil success rate, teacher diag- 
nostic sIdllSj and effective learning time. Hie implications of these con- 
cepts are ob\1ous for teachers, teacher trainers, and curriculuni and in- 
struct ion specialists* But what about principals? They are rarely, if ever, 
mentioned in the study. 

A common observation about schools is that teaching is largely an isolated 
activity carried out behind closed classrooms doors. The principal is often de- 
scribed as one who provides little instructional leadership, whose function 
seems limited to "handling the paperwork*" and keeping things running 
smoothly in the building. Contrary to these perceptions, the professional 
literature ccntaini abundant admonitions to and by principals to consider 
instrurttonal matters as their primary task. When principals gather to dis- 
cuss t*; ' r roL^ in the schools, there is usually considerable hand wrlngng 



ll wfli utilizg the term BTCS to represent the QonsteUation of teadier ^ehavion 
that were identified in the BTHS r§searelu 
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about the red tape and bureaucratic demands that keep them from ful- 
filUng their instructional destinies. What is more, the development of col- 
lective bargaining in education is viewed by many as further reducing the 
principals' influence on the behavior of teachers and the teaching process* 
Given this perspective on the principal's apparently limited impact on 
instruction^ it is legitimate to wonder about the impact the implementa- 
tion of activities based on the BTES flndings will have on the elementary 
school principal and what role the principal can play in those activities. 
Some obvious behavioral implications for principals emerge: forexamplej 
the principal can maximize Academic Learning Time by refraining as much 
as possible from interrupting teachers with announcements and requests 
and by backing the teachers' attempts to enforce discipline in the class- 
room. Principals can make provisions to provide sufficient insarvice 
training when needed. 

ft is the thesis of this chapter, however, that much more is required of 
principals if ideas from BTES are to be used successfully In classrooms; 
indeedj the principal's leadership is absolutely critical to the use of BTES 
findings. In the latter sections of this chapter^ rwUl disuuss the various 
components of the principalis behavior that are important- But before 
proceeding, 1 wish to make clear some assumptions I have about BTES and 
to describe my view of the principars role. 

A first major assumption is that the approach to teaching implied in the 
BTES is not readily practiced by most teachers. To be sure, much of what 
is reported in the study seems logical; e.g., the amount of student learning 
is related to time on task. But the implications of that finding are that 
steps are not uniformly taken to ensure favorable instructional conditions. 
As evidence, one can point to the wide disparity the researchers noted in 
the amount of time students spent on task from classroom to classroom. 
Similarly, I assume that the classroom management skills that would seem 
necessary to iinplement the BTES findings successfully, e*g„ student-to- 
student monitoring or providing work for students that is within the 
"medium success rate," are not uniformly known or practiced by many 
teachers. ThJs would imply that using related BTES concepts would neces- 
sitate revising, and in some cases reconstructing, the instructional practices 
and the accompanying teacher behaviors and skills. 

What is more, elements of this approach may be philosophically unac- 
ceptable to some teachere. BTES does imply a causal relationship between 
a particular kind of teacher behavior and student learning. Althou^ the 
philosophical underpinning of that implication is probably acceptable to 
many teachers, there are some who would subscribe to educational 
processes that they would consider more naturalistic or humanistic. Some 
will question the validity of the findings and the assurnptions about human 
behavior that support BTES. Gome would argue that BTES is too narrowly 
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cognitivi to warrant serious consideration as a means to impart the higher 
and mora affective values for which the ^hooli are responsible.^ 

In summary, I assume that many teachers will lack the requisite skills to 
develop activities based on BTES and that some teachers will doubt the 
validity of this study as a basis for restructuring teaching in their class- 
room. 

TTiis leads me to a second major assumption. In many schools, there 
will be a sufflciently large number of teachers who will lack requisite sWlls 
or wiU be so philosophically opposed to this approach (or both) that a 
decision to implement the BTES concepts on a schoolwide basis will result 
in a considerable revision of the school's initructional program. In those 
instances, the implementation process should be considered as an innova- 
tion in the school ^ and the research litemture on educational change and 
innovation will be instructive in assessing the principd's role. 

The Principar§ Role in Applying the BTES Ideas 

I turn now to a description of the principal's role in applying BTES 
concepts in the elementary school Hie role can be divided rou^y into 
three categories: substance, process, and support. , 

By substance, I refer to the initial need for the principal to be thor= 
ou^y acquainted with the substance of BTES and knowledgeable about 
the implications the study has for the ^hool, classroom, pupils, and 
teachers. I will identify this role as that of ^^knowledgeable colleague.'* 

By process, I mean the principal's imowledp of the school as a social 
^stem and skill at implementing an innovation in the school. I will 
identify this role as "process monitor.*' 

By support, I refer to the principal's responsibility for providing^ as 
much as possible ^ those conditions, materials, and individuals that are 
diown to be critical to the successful use of BTES concepts in the school. 
I wiU refer to this role as "supportive leader." 

Tliese roles must be fulfilled in any elementary school that intends to 
implement an approach based on the BTES. Generally, these roles will be 
fflled by one person— the principal* It should be noted, however, that there 
may well be instances where one or more of these roles are fulfilled parti- 
ally or entirely by someone else in the elementary school building; e.g^ an 
assistant principal or teacher. Perhaps a more accurate description of 
school leadership is to say that it is the principal's task to ensure that these 
roles are carried out successfully in the school by someone. I suspect that 



^See the chapter by Francei Kliin in this volumi for an in-depth discussjofi of 
virioui phUosDphical idewi on thf BTES approadi. 
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most elementary schools are sufficiently small that thisa roles are carried 
out by the principal. Thm, I wHl refer only to the princip^'s role in this 
chapter^ while recopiizing that it may indeed include more than one indi- 
vidual. 

77?e Principal as Knowledgeable Colleague: Substance 

An aU too familiar figure in the elementary school, and one that raises 
the ire of teachers, is the principal who encourages the introduction of 
some change or innovation in a school building but never takes the time to 
become personally familiar with or engaged in the innovation. Such princi* 
palsj in the eyes of teacherSj appear to be eager to latch on to some 
innovation not so much for substantial instruction reasonSj but because 
the involvement of their school will make the principal appear innovative 
or progressive to his or her superiors. The principal in these instances 
effectively transmits a lack of commitment to the change he or she \\dshes 
the staff to implement. 

An example of the consequence of thii type of nonengagement on the 
part of teachers and principals would be the very limited implementation 
of the main features of the progressive movement in education and of the 
educational philosophy advocated by John Dewey, Much of what the 
progressive movement stood for and many of Dewey's ideas were not 
sufficiently understood; as a result, they were superficially and incorrectly 
implemented. 

The BTES may appear to have little in common with the progressive 
movement in education. For purposes of this discussionj however, they are 
similar in that they both contain complex relationships and processes that 
can be improperly distilled down to a few simple practices. To the un« 
sophisticate di an isolated set of practices might seem to be an accurate 
application of these theories, but in reality they mi^t miss the very 
essence of what is needed. BTES ultimately describes a set of teacher 
behaviors intended to increase student leamingi but its flndinp can be 
misapplied if they are not used with a thorou^ understanding of the 
study*s inteUectual underpijinings. 

"Hiis being the case, it becomes critical that the principal assume the 
role of "knowledgeable colleague'* in the school. To fuifill this responsi- 
bility, sAie should do the following three thinp: 

1. Know and understand the BTES study thorou^y-the assump= 
tions underlying the study, the study's research design and 
methodology, the flndlnpi recommendations itiade by the 
study's authors, strengths and weaknesses of the study, and the 
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limitations those weaknesses place on the findings and 
recommendations, 

All research studies, no matter how well conducted, are based 
on certain assumptions and suffer from methodological problems. 
The BTES is no exception. Perhaps nothing can contribute more 
to discrediting the BTES than an overzealous and misinformed 
push to implement changes based on its findings. The researchers 
are fully cognizant of the strengths and weaknesses of their work; 
those who attempt to use it should be no less informed. 

Another reason why the principal should thoroughly under- 
stand this study is that s/he is the designated leader of the school 
and as such should be prepared to explain or defend the school's 
implementation plan and involvement in BTES to friends and 
critics alike. 

2. Know the implications of the study for the teachers in the prin- 
cipal's schooL A plan based on BTES could require teachers to 
have certain diagnostiCi teaching, and classroom management 
sldUs. Presumably^ the memben of a schoors teaching staff will 
differ in the degree to which they already possess these skills or 
are able and willing to acquire them. If these skills must be ac- 
quired by teachers to implement BTES fin din gs^ it becomes the 
principal's responsibility to orchastrate that effort. A common 
standard Inservice program for all will not suffice* A plan must be 
developed that allows for a different level of skill development 
for each of the teachers=some will take intensive work, others 
may need little or no wovk, others may choose not to participate 
or may simply be incapable of benefiting much from further 
inservice training. 

It is likely that many schools will have to apply their BTES» 
based approach on a "broken front"'; i.e., not all teachers will 
participate in this approach, and those who do will differ in the 
possession of needed instructional skills and in their ability to 
implement it successfully in their classroom, 

3, Be willing to participate as an involved member of the faculty. 
The implementation of any educational innovation will cause 
frustrations, anxieties, and problems for some teachers. If they 
are to be willing to endure these problems, it is incumbent on the 
principal to know from firsthand experience what the problems 
are* Put another way, s/he owns the problem also! 

One of the observations many educators frequently make about 
American elementary schools is that we have placed the principal in a 
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fulNtime administrative position and removed him or her from the class- 
room, The dsgrea to whieh this practice has lessened the principars cur- 
ricular and instructional role in the school varies from principal to prin- 
cipal, but in all too many cases the principal has abdicated instructional 
leadership as a matter of choice or necessity. 

When this happens in K:hools that are implementing innovations, the 
principal limits his or her involvement to occasional classroom visits^ or to 
shepherding \1sitors around to show them "how we are doing it,'* Such 
remote leader behavior simply will not suffice with BTES-based changes. 
What is nee ^d is a principal who i^^ fully engaged with teachers as a 
knowledgeable colleague in the classroom. 



Tlie Principal as Process Monitor: Process 

Earlier in this chapter I stated my assumption that the teaching sldlls 
needed' to use BTES findings may not be widely held by teachers and that, 
as a result, the adoption of a BTES-based approach on a sehoolwide basis 
would require a considerable amount of change in the school It follows 
that the introduction of BTES elements should be considered as an innova- 
tion* and the research literature on the implementation of educational 
innovations would, thereforei seem related to this chapter, 

I should like to turn now to two major research studies on educational 
innovation and discuss the findinis of those studies as they relate to this 
topic. The two studies are the I/D/E/A Study of Educational Change and 
School Improvement (Bentzenp 1974; Goodlad, 1975) and the RAND 
Corporation study of Federal Programs Supporting Educational Change 
(Berman and McLaughlin, 1975). These are comprehensive studias of edu- 
cational change that should be read by anyone who is seriously interested 
in implementing educational innovations. From these studies emerged 
three critical findings that are related to this topic: the critical role of the 
prLncipal in educational innovation, the importance of institutional owner- 
ship of an innovation, and the concept of mutual adaptatiom 

The critical role of the principal in educational innovatiotu Actually, 
this statement is a derivative of another assumption and finding from the 
I/D/E/A and RAND studies; namely, that the basic unit in educational 
innovation is the school site= Attempts to implement innovations from the 
national^ state, or school district level have been largely unsuccessful if 
they^ have not viewed the school site as the essential unit of change. The 
principaU of course, is the desipated leader of the school site, and it 
follows that s/he would play a critical role in implementing educational 
innovations. Time and again it has been demonstrated that if the principal 
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is not conumtted to prodding institution^ leadership during the introduc' 
tion of an innovation, the inno^tion vnll not be sUGcessful. 

Ensure imtitutiond ownership. By the term oTOershipi I refer to the 
depee to which the relevant faculty and staff members apee that a pro- 
posed innovation is important to their sehool and that they diould 
dedicate their personal ene^ei and resources to assuring its implementa- 
tion, Perhap one of the clearest and most consistent flndings of both the 
I/D/E/A and RAND studies was the powerful effect ownerdup had on the 
successf^ implementition of iimovation. 

This, of cou^j is not a very surprising finding; indeed, it makes good 
common sense. Wmt is more, I would guess that most principals^ central 
district idnMniatratorSp and State and Federal officii would readfly agree 
to the importance of oTOerAlp. 

Yet one constancy nmi into atuations where this fundaments concept 
is ipiored or pven improper emphasis. Often this happens, I suspect, be- 
cau^ the innovator really does not believe that teachers are interested in 
or capable of appreciating the importance of a particular innovative 
scheme, or because tiie innovator is so zealous in his or her belief that the 
proposal is sound and "in the best interest of Idds" that s^e ^not 
imagine how school colleagues could not support the concept as soon as 
they are properly "enU^tened.** TTie unfortunate msult of this inattention 
to ownerdiip is an educational landscape that is cluttered with the wreck- 
ap of unsucce^ful innovations. 

Hie principd's role in bmlding Institutional owne^p is to develop a 
decisionmakUig structure that dlows tho^ who mil be affected by the 
innovation to discuss the propo^d Innovation openly, freely, and thor- 
oughly and come to a collective conduaon about whether to and how best 
to adopt it* The exact way in which this owneidiip building process is 
accomplidied will vary among schools. Some principals use generd faculty 
meetings for this purpose, while others use faculty committees or school 
site councils or the informal organization of the schooL Usually some 
combination of these approaches is used, and it takes time. A common 
error is to devote a relatively diort period of time to tius owneBliip 
buflding, secure a superficial apeement to bepn, ^d then rush into imple= 
menting the project. Often a result of rushing into it is that when the 
teachers be^ to encounter obstacles or problemSi they be^ raising 
fundamental questions that diould have been resolved earlier* At this point 
factions develop and the cooperative spirit needed to sustain an innovation 
evaporates. [The reader is referred to tiie Dialogue, Decisionj Action, 
Evaluation-DDAE^process in the I/D/E/A study (Bentzen* 1975).] 

Many principals apparently find o^a^ip buildLng difflcidt. Teadiers 
often report leader staff meetinp as rituals where tnnsi matters are dis- 
cuMed and sendtive issues are avoided, I am unsure why this happens. It 
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may be that some principals simply do not define their leadership style as 
involving teachers in these kinds of decisions; it may be impossible for 
others to find time to spend with teachers in this way; while others may 
simply be unskilled in working with teachers as colleagues. Principals who 
want to implement innovations in their schools successfully must develop 
the skills necessary to build the staff and faculty's ownership of the pro- 
posed innovation. Failure to do so will considerably reduce the chances of 
implementing the innovation successfully. 

Froviaing for mutual adaptation. One of the most powerful findings of 
the RAND studies was the concept of mutual adaptation. (This concept 
was not identified in the I/D/E/A studies but was implied in the findings.) 
It means that in the successful implementation process both the inno- 
vation and the Institution in which it is being implemented must change or 
adapt to each other for a proper fit. Schools are generally very similar in 
design and operation, but within that common framework important varia- 
tions do occur. For example^ schooli differ in such important char- 
acteristics as age, teachinf experience, and competence of the teachers; 
socioeconomic status of the pupils; degree of functional autonomy; and 
quality of principal leadership. 

These variations can have profound influences on the way in which an 
innovation is implemented, In one schoolj some teachers may play a major 
role in providing inservice training to other teachers, while in another 
school teachers rtiay have to receive all their inservice training from outside 
resources; in one school, it may be appropriate to implement a new 
approach in virtually all the classrooms^ while in another it may be placed 
in only half the classrooms. In one school^ the decisionmaking structure 
may be completely compatible with the developmeiit and maintenance of 
institutional ownership^ while in another the entire decisiorunaking struc- 
ture may have to be revised before institutional ownership can be 
developed, The list of potential mutual adaptations is as endless as the 
variations one can find in schools. 

The Principal as Supportive Leader: Support 

As anyone who has tried to do something different or new wUI readily 
attest, considerable discomfort and anxiety often accompany innovative 
efforts. New patterns of behavior have to be substituted for older, more 
comfortable ones* Success at the new activity is often elusive, concepts 
and theories somehow never work out quite the way they were intended; 
ikeptics are always anxious to say "I told you so'' when your program or 
progress falters. Many of the teachers who use the BTES findinp will 
encounter some or aU these situations. In view of thiSj teachers need all the 
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support and help from the principal that they can get if they are going to 
use BTES-related activiti^^ successfully in their classrooms. 

Some of what has been written above about principal behavior can be 
described as supportive--e.g,, providing appropriate inservice training=and 
I wiU not elaborate on those points further. For purposes of this dis- 
cussionj I wUI characterize supportive behavior as being either internally 
focused or externally focused. 

Internally focused supportive behavior. By this term I mean the 
manipulation of conditions, materials, and individuals within the prin- 
cipal's school so as to support as much as possible the teachers* efforts to 
implement their BTES-based approach. Many things might be identified by 
the principal and teachers as being supportive of the teachers* efforts: for 
example, reducing classroom interruptions by the principal's office during 
designated periods of time; stron^y backing teacher requests for disci- 
plining students who persistently interfere with a teacher's efforts; maxi- 
mizing the fl exibUI ty of the schoors schedule so as to allow teachers 
opportunities to \dsit other classrooms and school buildings to observe 
skilled colleagues; maximizing the use of the schoors budget to purchase 
materials and other instructional aids deemed important by the teacher. It 
is recognized, of couree, that the principars degree of freedom to provide 
such supportive assistance will differ considerably from school to school 
Some schools are beset by a large number of budgetary, organizational, 
and political pressures that severely limit the principal's flexibUity; others 
are not so constrained and may have considerable room for movement 

Externally focused supportive behavior Vm term refere to those 
actions of the principal that are addressed to parents, to the public, and to 
district level school administrators to gain resources and support for the 
staffs innovative efforts and to fend off attempts to limit the school's 
efforts. 

During the introductipn and implementation stages, special problems 
may develop that will endanger the innovative efforts. TTie principal ^11 
then need to exhibit supportive behavior on behalf of his or her staff and 
school Some examples foUow' the teachers may request supplies. Instruc- 
tional materials, or auxiliary teaching personnel that are above and beyond 
those which can be provided in the school's budget, and the prijicipal may 
need to request additional budgetary support from the district office. In 
another case, some parents, community members, or indeed fellow educa- 
tors may openly criticize and oppose the new approach and thereby 
jeopardize the continuation of the school's efforts. Many a promising inno- 
vation has prematurely failed because the program was inadequately de- 
fended or supported when slgnincant opposition developed. It becomes 
absolutely essential, then, that the principal become a visible and effective 
supporter of the school's program and efforts. 
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FinaUy, the principal should fend off efforts by external groups to 
evaluate improperly or prematurely how effectively the school has applied 
the BTES findingi. There are always those who demand instant success, 
and they will press for early positive evaluations as a condition for their 
continued support of the program. It must be realized that there are many 
conditions and interactions that determine the success of any innovation. 
It takes time for innovators to learn what does and does not work and to 
provide for mutual adaptation. It is the principal's task to defend his or 
her school against demands for early evaluations of the project. What is 
more, the principal should assure that those evaluations that are completed 
are not overly simplistic and that they fully account for the complexities 
of implementation of any educational innovation. 

Implied in this discussion is the need for the principal to acquire some 
protection from the school district office* It is always difficult to be 
different, Fellow administrators (principals and centrd administrators) 
may view innovative efforts with little enthusiasm; they will give no sup- 
port, or will even attempt to undermine the program, The principal simply 
has to fend off detractors and to sustain the school during crisis periods. In 
an effort to shore up defenseSj principals and school districts might well 
consider the development of a consortium structure such as was used in 
the I/D/E/A League of CooperatLng Schools (Bentzen, 1975). 

At this point, it is important to note the critical role that district level 
administrators play in developing and sustaining their principals' risk- 
taking behavior. The tendency for complex organizations to lirnit their 
employees* willingness to try something new is well known. In school 
districts* the principals' conservative behavior is often a realistic response 
to their perceptions of the limited value central administrators attach to 
Innovation, It is not likely that principals will take ri^ks when they see the 
rewards going to those who *'play it safe." If central administrators wish to 
encourage principals and their staffs to apply BTES findinp, they will 
have to make it clear by word and action that they value risbtakingj that 
they will reward those who become engaged in change effortSj and that 
they will support principals if and when projects do not immediately 
produce expected results or when projects are faced with sipiiflcant oppo- 
sition. 

Again, it should be noted that the likelihood that principals will be able 
to defend their schools successfully against external pressures or to pro- 
cure additional funds will differ from school district to district. Even if the 
principal is unsuccessful in his or her attempts, just the fact that s^i is 
willing to put up a good fight will often serve as a motivating force for the 
teachirs in the schooL 
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ConcluiiOi. 

This chaptar has described the implications for the principal of imple- 
menting a BTES-based educational approach in an elementary schooL A 
major a^umption has been that tediniques implied in the BTES are prac- 
ticed in vao^ing degrees by most teachers^ and a considerable revision of 
the instrucdonal program may be necesiary in many classrooms. This 
being the case, the new plan diould be considered an innovation, and the 
research literature in educational innovation is relevant to analyzing this 
topic. 

The main behavioral implications for principds that were identified and 
discussad were: 

L "Die principal is knowledgeable colleague (structure) 

a. Know and thorou^y understand the BTES study. 

b. Know the impUcationi of the study for the teachers in the 
principal's schooL 

c. Be willing to participate as an engaged member of the faculty. 

2. 'nie principal as process monitor (process) 

a^ Understand the principal's critical role in the innovation 
process. 

b* Ensure institutional ownership, 
c. Provide for mutual adaptation. 

3. The principal as supportive leader (support) 

a. Provide internally focused supportive behavior. 

b. Provide extem^y focused supportive behavior. 

Some will argue that what I have describad in this chapter is a nice 
theoretical desigrii but the Ukelihood of anyone actually behaving this way 
is smaH indeed. The demands on principals, they may maintains ^re such 
that strong leadership behavior is impossible in today's schools. I disagree. 
This kind of leadership behavior can be found in schools today, although, I 
fear, far less often than it ^ould be. There are principals who provide this 
Wnd of leadership, and ihtlt impact on schools is dramatic. In the long 
run, I suspect that it aU comes down to what a principal viev^ as his or her 
priorities—instructional or administrative. 

Of one thing I am quite sure: schools that attempt to use the BTES 
findings without a ^ichool leader who displays many of the Wnds of be« 
haviors I have described will probably not be very successful. 
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A Perspective in Curriculum 
and the Beginning Teacher 
Evaluation Study (BTES) 

M, Frances Klein 

TTie field of study callad curriculum is broad and cQmpIax. Some of the 
scholars who have devoted their careers to the study of curriculum can 
ap-ee on little except the importance of the field. Hie assumptions held 
and positions developed by one scholar in the fleld are rejected by an- 
other. The curriculum field has been pronounced moribund^ and the sug- 
gestion has been made that workers in the field should abandon it 
(Schwab, 1970). Some scholars have stated that many of the current 
practices in curriculum are miidiricted, undesirable^ even unethical, and 
curriculum as a field of study needs to be completely redirected. TTiere are 
those who are conmced that if efforts now being made are continued, 
sipiiflcant progress in the education of young people will be made. Hie 
debates in this field have filled volume after volumi as differing positions 
have been developed by scholaWj each of whom is hi^ly rispected by 
many for his or her contributions to the thou^t and work of those in- 
volved in curriculum development. 

As a result of my own study and work in the field, I have concluded 
that to use only one view of curriculum growing out of the work of the 
scholars is limited. Successful educational practice must try to draw on at 
least two different views if we are to accomplish what we hope to do in 
schools for and v4th our young people* Just how we can blend these two 
views in classroom practice is not clear, and much research is still needed, 
BTES certainly helps further our understanding of how one view con- 
tributes to schooling* I believe it is essential, howeverj to make clear in any 
discussion of curriculum the basic podtion and assumptions being made, 
and then to balance those with other needed positions and assumptions, 
"niat is the purpose of this chapterp I will discuss briefiy two basic posi- 
tions in curricuhim and place my ideas about BTES and its importance 
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within this perspective. I will suggest some possible areas for future re* 
search on the BTES model and will identify some implications for pre- 
service and inservice education of teachers. 

Conceptualizations of Curriculum 

There are several different conceptions of curriculum that appear in the 
literature. Each of these can have a differing effect on classroom practices. 
Eisner and VaUance (1974) have identified five: development of the cog- 
nitive processes, the techinolo^ of curriculum, personal development, 
social reconstructions and academie rationalism. T^iose who view curricu* 
lum as being largely the development of cognitive processes emphasize the 
basic abttities involved in thinkingj which can be used in any future 
learning. Content or what is thought about in these processes receives far 
less emphasis than the processes themselves. TTie intent In this view of 
curriculum is to help the student develop intellectual autonomy. 

Curriculum as technolo^ is concerned with how to develop products 
and methods that will help students learn effieiently and effectively what- 
ever they are intended to leam. TOs approach uses predetermined 
definitions of what is to be leamedj from which specialisti proceed to 
develop the technology of instruction needed to help students achieve the 
desired learning. It is concerned primarily with communicating knowledge 
and facilitating learning in efficient ways. 

In the view of those who see curriculum as personal developrnent, the 
emphasis is to assist all students to become self-actualized and autonomous 
persons. Content is important to the extent that it helps students in the 
process of personal development and liberation. Many diverse outcomes of 
learning are desired, and each person is helped to develop his or her own 
personalized curriculum. 

Curriculum as social reconstruction emphasizes social goals-the better- 
ment of society. Curriculums should help bridge the gap between the way 
society is now and how it ou^t to be. They also should help develop a 
better fit between individuals and society. Students study social problems 
and attempt to improve society throu^ their work in the classroom and 
community. 

The academic rationalists \1ew curriculum as the attempt to enli^ten 
students in the best ideas and objects produced in the past, using largely a 
Western perspective. HumanWnd's heritage is screened for those ideas that 
have been profound and long-lasting, and they become the basis of the 
curriculum. These ideas are to be found primarLly in the organized disci* 
plines of knowledge, and such disciplines are used as the basis for curricu- 
lar design. 
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Pinar (1978) has identified^ three basic ^oups in curriculum' tradi* 
tiondiitSi conceptual-empiricists, and reconcaptualisti. Tlie traditionalists 
seek principles to be followed in curriculum planning and implementation 
and are very prapnatie in their approach. ITieir work is desipied primarily 
to serve the practitioner in the schools. The conceptual-empiricists believe 
that a science of human behavior is possible and that curriculum is a subset 
of this science. I^iey use the natural sciences as their model for study and, 
from their work, they attempt to create a science of curriculum. They 
search for knowIed|e that would be of freatest use to the practitioners. 
The reconceptuahsts attempt to develop new ways of viewing and theori' 
ring about curriculum. Th^^ see their work as a creative intellectual task 
that should not be used-at least, not yet-as a basis for prescribing prac- 
tice or generating a verifiable theory. They hope to evolve conceptual 
schemarics that wiU offer new ways of viewing curriculum and explore 
how these might affect practice. 

In my view of curriculum^ I identify two basic conceptualizations of 
curriculum that ou^t to be used to direct classroom practices: be- 
haviorism and reconceptualiim. My groups are not ve^ different from 
those identified by Eisner and V^EUce (1974) or Pinar (1978). The recon- 
ceptualists as I see them are basically the same as Pinar*s (1 978), and they 
seem to combine the two groups which Eisner and Vallance (1974) de- 
scribed under the headings of self-development and s^^cial reconstruction, 
Hnar (1978) indicated that the term "reconceptudists'' is somewhat con= 
trqversial, but it does seem to best describe their primao' effort, My be- 
haviorists may be the traditionalists and conceptual-empiricists as de- 
scribed by Pinar (1978) and the curriculum technolo^sts, acadeniic 
rationalistSi and adherents of curriculum as co^itive processes identifled 
by Eisner and Vallance (1974). Hie label of beha\dorists makes clearer to 
me their assumptions and practicesp however. Behaviorists draw heavily on 
the beha^oral sciences in their search for principles of curriculum develop- 
ment. These two groups of scholars in curriculum— reconceptualists and 
behaviorists— hold different \iews about the pu^oses, the prwesses to be 
used J and the desired results of curriculum development. ITiey start with 
different assumptions and vdue positions, and the curriculums they in- 
fluence are vBty different. In the following parapaphSj I will discuss 
selected dimensions for distinguishing between these two groups. These 
elements are also those that appear to be pardcularly related to the BTES 
study. 

It should be emphasized that within eadi of the two groups of the 
reconceptualists and the behaviorists different subgroups can be identifled 
among whom there is substantial disapeement. The use of the two labels 
masks the differences ^thin each group, but It does allow for a broad 
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comparison between two poups. Each holds similar geniral views on what 
cumciUum ou^t to do and how it diould do it. 

The behaviorists adwice a conception of curriculum based on a clear 
statement of predetermined outcomts of curriculum and on careftil plan- 
ning of the means by which these ends mil be achieved. 'Die mtionale for 
developing cuniculums described in Basic Principles of Cwriaulum and 
Imtruction by Tyler has done much to help establish ths ac^ptance and 
popularity of this conception, to Ms monopaph, ori^dly written as a 
^Uabus for a paduate course in curriculum and instruction, Tyler raises 
four questions that must be answered to have a comprehensively planned 
curriculum: 

1. What educational purpo^s diould the sdiool seek to attain? 

2. what gdu^tionil expiriinces can be provided that ire likely to 
attain these pisposgi? 

3. How ran these edutetional experiencii be effectively organized? 

4. How can we detenmne whether these purposes m being attained? 

The behaviorists view education as planned changes in beha^^orj which 
is broadly defined as thou^ts^ fealinpp and actions. TTiese planned 
changes are stated clearly and succinctly as beha\iofal objectives, and the 
development of behavioral objectives is seen as one central task in curricu* 
lum development. Often behavioral objectives reflect a sequential 
approach to learning where one objective builds on a preceding one. TTiis 
sequence ultimately should lead the student to developing more complex 
behaviors. Instruction is planned and conducted so students wfll adiieve 
the desired behavioral objectives. Objectives become the focus of class- 
room work. Evaluation in this \iew of curriculum focuses on the develop- 
ment of procedures and instruments that measure the extent to which the 
student has attained the objectives. 

Hanning prior to classroom instruction by the teacher is emphasized, 
dthou^ the teacher has direction and help from many others such as the 
State, community groups, students, and district officials, ^e teacher is, 
however, the key decisionmaker. Tlie role of the teacher is to be in charge 
of instruction and the classroom and, hopefuMy, to be an expert in the 
subject matter to be taught. 

Behaviorism is an approach to curriculum development that has been 
studied and practiced vwdely. Part of the extensive use of behaviorism 
comes from the fact that it is compatible with a number of strong current 
societd trends such as accountability and the emphasis on **back to the 
baii^*" It is a rational, lopcal conception of curriculum development and 
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drawi heavfly on the iti Ddf s of planning and mquiiy eh^acteristic of our 
techflolop^-induitiiaJ-scientiflc iociety. 

"nie reconceptualjsti, howevar, reject outri^t the beha^oral ipproach 
to ciiniculmn divelnpment and proposa in alternative. Some of the recon- 
captudiits tried to aniwr the biMc qu^tioiw raised in the TyUt rationalf 
(1 949) but wanted to ^ve them diffar ent answers tlian are typicdly given* 
They abandonad this approaoh ba^use they raeogiizad that they must 
begin witfi an antirely diffarant conception of cuniculum (Macdonald, 
Wolfson, and Zaret, 1973). Tliey do not baliava that the maani^nd ap- 
proieh to curriculum pknniiig is the only or bast one, ^ay do not beUave 
ieamlnf, teadiers, or students should be controUad and constmined by tha 
use of behavioral objactives. They do not accept the dominanca of the 
taacher in planning and implementing cunicidums, and they do not ac^pt 
standardizad teiting and other objectiva procedures to measure what the 
student has leamad as tlta primaiy way to evmluata learning. Not only do 
they reject these ideas as undesirable; thay consider theni to ba unethicd. 

Ihe r^oncaptiialists empham^ salf-actualization and the development 
of an autonomous person as the primaty purpose for developng curricu- 
lums. To themj this approach suggests much freedomi although with struc- 
ture for each student to be tfie prime decisionmaker about his or her own 
curricdum. They beUeva fiiat what is learned from the curriculum is 
unique to each indi^ddual and ^nnot hn determined prior to the actual 
enpgemant in classroom activitias. Mmy dive^a outcomes are thus ex- 
pected and desired as a result of experiencing curriculums. The recon- 
ceptuaBsts use a hoUstic approach to learning rather tfian a reductionist 
approach of breaking down what is to be leamad into a series of sequential 
steps. Ihey emphamze the need for a clear statement cf what one- s values 
are about society, education, and indi^dduals as basic to curriculimi devel- 
opment so as to be sure these values are mamfeitad consist antiy in prac- 
tice. 

The quality of the educational environment and of life in the clasiroom 
also are idantijRed as basic eoncanis in curriculum development. TTie recon- 
captuaUsts propose activities and time in the cla^room that permit 
students to explore ideas and problems freely, to intapata what is learned 
from those explorations into a tentative personal perspective; and to traiis- 
cend tiiosa tentative understandinp to arrive at a pe^ond ind^t and set 
of meaninp, TTie role of the teacher is defined as facilitator and co- 
inqiUrer along with the student into si^flcant ideas and problems. Self- 
evaluation by teachers and students is amphadiedj along mth social 
accountability in relation to directions and purposes apeed on throu^ 



\^de participation by many ^oups in society (Macdonald, Wolfton, and 
^ret, 1973), 
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BTES in a Cumculime Ftmpmfm 

Givin themt iw© coneaptions of curriculum, ^him ine dots Wi' 
c1o5€ly spec mth, and what hM^m to make it an iniportmnl study? BTES 
complex and, m %mh, U difRcult to um^m^ ^OTi^etdy portraymg 
only one pgmp^etiVe of currts^lum and mi iJther. Soto damerits of 
the study mmt to draw m the posiaons c^f both tha bihavtoristi and tlifc 
reconcept«aUiti to same de^e. In my mw of the svidf, liowav^r, tht 
behavior^t position was used much more con^meatly than tl^ tcQm- 
captu^L 'nius, the contributions of tha sLudy wfll be to mt 
und^rsnindlng of cteroom practtos bpMd on behawrism, 

Aithou^ til© research in BTES is not dearly labeled m \^-imnom, that 
^pect becomei apparent the dlmandons mmi to discdbe the re- 
March are axamiiiid. model is prtmanly ^^mcenm with aademic 
p^suits and suggests wi^vh in wliid^ dmmmn timi and activiuM mi be 
used to msjomi^e adkr^^vimant of jir^diiemuned oylconief: saquenUal 
sk?Us in reading ar^ J^tgiiu Ajthou^i BTES recopuzes the importanee of 
student attitudes t^myd ichool and subject areas, it does not ^ve them 
the proniiner>w this* It pves acid^mic pu^Bmis, in BTBS, the teacher is in 
contf oi of the iMmoom md is the primary decisionmaker. Tasks on which 
stmk^t^ ipend time are weU defined and primarily identified by the 
teachsf, who. n^ds to be knowledgeable in that subject area, particuiariy 
for the diapiDSii of the modeL Objective evaluation procedures are 
used to measure student achievement of reading and mathemadcs sWUs 
and understandinp. 

By contrast, it is dear tiiat there is not much freedom for students to 
be the primary decisicnmakeR, and teachers are not co-inquirers. Class- 
room acUvities are not developed so studenu can freely explore ideas and 
problems to gain persond msi^it, intepation, and transcendence of what 
is learned, &lf^^^uation by teache« and students is not discussed in 
summaries of the research^ 

Some goals of curriculums^such as development of communication 
sldlls, baac understandmp of subject matter, and development of cog^ 
nitive sldUs-^woiad seem to be compatible mth the use of the BTES 
model The basic teadiing functions of diaposis, prescription, presenta^ 
tion, monitoring, and feedback and tiie concept of active learning tinrte as 
developed in the BTES research do musA to help us imderstand how to 



h mntm to w "igtive ieanung ttme^ rather than "Aradtnttc LtMning Ttai, 
wWA has b^n mid tlsewheri m this pubU^tion. It !i my beUif fliit mort lubjcpt 
mm ^^r the dttrieulum m jm the ^n^pfe developtd m this Kieitdi as effertivily 
M ^ thDM wWdi m sometiin^ lefemd to as *'acidiii^e" subjegts, as opposed to 
'^o^sdeiriQ'' si*^cts. Su* a dy toction may prove to be artifidal and hntttmi in 
futu^ rei#af^* 
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desipi cliOToom practices lo wi can attain goals such as these. At the 
same ttae, however, it must be reco^ized that there are curricular goals 
tiiat mhy not be developed as effectively* if at all, using only one con- 
ception of curriculum, Developin| autonomous, ^If-directed* creative 
students who can plan and implement their own learning purposes and 
icti^ties throu^out their lives, develop a unique and persond per* 
spective on their learnings from claMroom activities, and who are aware of 
their own and society's valuei iii like otiier such posable outcomes, very 
desirable to many. Hiese typ&s of learning outcomes rnay be more effec- 
tively developed if practice is based on the reconceptualist view of eurricu- 
ium. I believe that tlus in no way Undts the contribution of the BTES 
study, but it does help place it hi a curriculum perspective. Clarifying the 
study's position regarding curricidurn makes it eader to identify some 
factors that help aecount for its Importance. U also raiies some questions 
for further research and su^ests somte eswntial components of curricu- 
lums mt the professional education of teadie^* 

Many respected curricdum researchers and practitioners subscribe to 
tiie behaworist view of cumculum, and it h the model teachen are 
generally taught. Many educators and lepslators at the State aid Federal 
levels also follow behaviorism in curriculum decisionmaldng* This makes 
BTES compatible with otiier important work in the field and gives it 
added import^ce to the profesrfon. It is a d^flcant study that extends 
our underi tanding of one conception of curriculum and possible residting 
practices and benefits. The concepts and processes that BTES examines 
dioidd help improve practice deigned to adueve certain desirable learning 
outcomes by students. 

It is sipdflcMt for other reasons, also. It is a carefidly conceived and 
rigoroudy implemented study byhi^y competent researchers* TTierefore, 
what was selected for study and reporting ^^re those concepts central to 
the bdiaviorist \iew of currlcidum. It is a lonptudind study, ^dth the 
various stages extended over 5 years* a longer time span than educational 
research can normaQy afford, Ratiier tJian studying the teaching of a 
^cific le^n in a limited time, the re^archeri studied successful 
teachers, students, and classroom practices over a long time, analyzing 
careftilly what contributes to one type of success in schooling md what 
interferes with it, Tlie study did not occur in a quiet laboratory reserved 
for studying teacWng and learning; it occurred in real classrooms, each 
with a teacher, studCTts, and an ongoing educational program* Hus factor 
surely compounded the difficulty of the researches* work, but it con* 
tributed a^ficantly in developing an undirstanding of some of die 
successful practices of ^hooling. 

The BTES model is not a simplistic explanation of complex 
phenomena* It is a model with interactive components that wiU be 
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modified by va^ing classrooni situations. It has some limitations, and it is 
not presented as a flnished product, TTie modil dearly is not fuUy under- 
stood and must be extended in future research aetivities. TTie importance 
of the model undoubtedly wiU ^ow as further research Is conducted on it 
and as practitioners examine its relevance and posable variations in differ* 
ent classroom situations. 

Possible Areas for Future R^arch 

There are at least four areas relating to the use of the BTES model in 
curriculum development that suggest the need for future research: 

1. How applicable it is to affective goals in reading and math and to 
goals in other areas of the elementary school curriculum? 

2, How effective the model is at other levels of schoolings and what 
adaptations may be needed? 

3. TTie ways in which the BTES model can be adapted to the con- 
straints and uniquenesses of different iocal situations and still 
remain effective. 

4, TTie extent to which the BTES model can be used effectively in 
classrooms along with conceptions of curriculum such as the re« 
conceptualisi view. 

The findings of the BTES report and other studies stron^y suggest the 
usefulness of this model if achievement in reading and mathematics is to 
be maximized. It probably was not by chance that these two areas were 
selected for study in the BTES research and by many others. Reading and 
math skills certainly are considered by most people to be essential compo- 
nents! if not the corej of the elementary' school curriculum. Research on 
them is particularly timely in ^ew of the current emphasis on "back to the 
basics." Both subject areas have a structure and developmental sequence 
that many curriculum planners have defined witii some similarity^ addition 
is tau^t before multiplication; sounds o^f an^e consonants and vowels are 
tau^t before blends of letters and syllabication. 'Diii would assist the 
researchers considembly in deciding how to define student success. 
Students who achieve competence in the sequence of ikiUs are succ^sful* 

However, the BTES examination of math and reading achievement 
represents a limited number of goals and objectives— those primarily con- 
cerned with cognitive sldlls, Affective goals in these subject areas— such as 
appredation of good literature, valuing reading as a leisure time activity, 
and appreciation for the structure of mathematics— were not studied* ^ey 
are often stated, however, in comprehensive curricidum plans and are 
usually conadered to be desirable outcomes of any curriciUum in reading 
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and math. Hie extent to which the BTES model can be used r : 
these affective goals is not known. Different classroorn ». 
eUmates may be needed to help students achieve them. R' . ■ 
appropriate feedback are not as dearly apparent for the.^-: .iw 
in the cognitive sMls in reading and math. To attain ols mi^t 

require the use of dtemative models generated from ot Qceptions of 
eurrieulum such as the reconceptualists'. IHie BTES and other 

models need to be studied in future resaarch to deterir i can assii- 

most effectively in the development of affecdve gods Jn and math. 

The u^ of the model, and others alsoj must be e .pi \n xeho 
the many and varied goals often stated for other ^ nreai 
curricidum— ^cial studies and science, for example. The n ioun. 
of variation to be found in the goals, objectives^ cor ent* ar 
strate^es within different curriculums in these object .:s 
fertile ground for further research on the BTES mc . jL Wl re ES 
model be equally applicable for such social studies goals ying 
values and developing good citizenship, or would other models L :m in 
helping attain them? Quite a different model, base n Lawre j Kohl- 
berg*s research on mord development, has been propL ^ to ht\-]^ students 
clarify their values and examine the impact of value positions on human 
behavior (Guidance Associates, 1972)* In this model, the teachef asks 
questions primarily to raise and support aU sides of a mor^ dHemma. 
There are no ri^t or wrong answers; any opinion given by a student is 
accepted as a basis of discussion and is used to challenge the students to 
think about what they would do in a moral dUemma. This strates^ does 
not use the basic teaching functions as defined in the BTES study. Much 
models or combination of models to use in helping students clarify their 
vdues is a question that needs to be explored in future research. 

'Diere would seem to be areas in social studies and science^, however, 
where the use of the BTES model would be very appropriate. To trnder- 
stand and the concepts of latitude and lonptude and to know and 
apply scientific laws and principles are examples of goals that probably 
could be taught and learned most effectively using the BTES modeh TTie 
application of the findings of this study to other subject areas in the 
curricidum also needs to be explored in future research and practice. 

Underlying my suggestion of future research in other curriculum areas 
is my dedre for a balanced curriculum in the elementary schooL Some 
research has suggested that curriculum in the primary yeaft of schooling 
consists almost exclusively of math and reading, with very limited atten- 
tion being given to other subject areas (Goodladi Kleins and associatess 
1974)* In the view of some, such a focus is desirable; to others, it is not* If 
tfie elementary school curriculum is to implement such varied goals and 
objectives as are usually stated, howeverj I believe it will need to include 
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i^ntial subject bi&m in addition to readini and math^ Wiat model or 
rnodeU cm mcmt affectively and effldently guidi dassroom practice to 
thieve afl the goals of a conipr^eniive sdiool curriculum muit be deter^ 
minid through future research* 

Another question that needs further exploration throu^ researdi is the 
extent to which the BTES modal nught be used at other levels of sdioollng 
and what adaptations nught be needed. For some da^es in the secondary 
schools, for e^nple, it nn^t be v^ry useful. For other classes, however, 
different models may be needed, just as at the elennentary level, ^condary 
teachers work under ve^ diffierent conditions froni elementaty^ teadiers, 
and the model mi^it need to be modified to be used at the secondary 
level. 

Sinularly, the extent to which the model is applicable at the coUege 
level must be investigated. CoUe^ate education occurs under different 
conditioiis from both elementaiy and secondary sdiooUng. It would be 
presumptuous to a^ume that the model a^ we now understand it is equdly 
applicable at any other level of schooling. For example, one po^ible modi- 
fication of the model at the upper levels of schooling mi^t be different 
definitions of appropriate success rates for learning tasks at these proves- 
sively more rnature levels. Perhaps a different balance between easy ^d 
difficidt tasks is needed for different levels of schooling. All these po^bili> 
ties must receive careful study. 

A third asp^t of the model that suggests further research is the varia- 
tion ^thin the concepts that may be required by differing loc^ situations. 
Schooling occuri throu^out the United States md wjthin ^e State of 
California in widely differing situatior^: for example, urban, suburban, 
and rur^ are^; wed^y and poor districts; hi^, middle, and low socio- 
Monomic communities; mixed racial and ethnic poups and nd^y md 
ethnically isolated groups of students; classrooms with experienced and 
inexperienced teacher. The research already su^ests that variation can 
occur ^thin components of the model— ways in which enpged time can 
be maintained by contact with die teacher, aides, peers, or materials, for 
example. "Hie extent to whidi locd variations will require modiflcations 
>^thin the model for maximal usefidness must be explored carefully and 
fystcmaticaDy for each of the components of the model as must their 
mterrelation^ps within the various levels of schooling. 

I have suggested the pombCLity that at least two models are needed to 
achieve the array of goals usually stated in a comprehensive curriculum, 
^lis iugpsts a fourth area for future research: ihe extent to which several 
models, developed from veiy different conceptions of curriculum, ^n be 
implemented in the sami dassroom or level of schooling and still maintain 
some continuity md consistency for the students. Researchers typically 
use primarily one model or another to guide their acti^tles. Rarely has the 
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usa of seviral models at the same time been explored. Wfll the i^e of 
several models with a single poup of students be confuang to them and 
causa conflict in what might be accomplished? Or ^ severd models be 
used effectively to hdp students gan different but equally deMrable bene- 
fits mora efBdently from their schooling? This is a basic question that 
must be studied careftjUy in the future. 

Implications for Proftsdonal Educalion 

The BTES modal is a powerfid set of ideas that dl professional educa- 
tors ought to study. Th^ concepts wed and tfie flndinp of the research on 
the model must be induded In professional education. It represents one 
possible way m whidi whooUng ^ be improved, and such ideas are 
always n^ded. 

How professional educators learn about the BTES model is extremely 
important. Its impact ^lU be greater if they leam about it in several wys: 
throu^ printed matter, discUMions, audio^sual materials, demonstmtionSi 
and guided practice. Reading, discussing, and using audio^lsual presenta^ 
tions are the traditional ways of educating about ideas, and certainiy these 
techniques ^dU facilittte learning about the BTES modeL Learning about 
the BTES model , however, must not stop there. A powerful instructional 
teclmique is modeling or, more popdariy stated, practicing what you 
preach. Modeling wfll provide an opportunity to obsem and experience 
the BTES model in practica in claMrooms. This t^hnique ^ould occur in 
classrooms in both sdiools of education and public sdiooli. The BTES 
model will have a far more limited impact than is desired if claMrooms 
where profesdond sMUs, Imowledge, and attitudes are tau^t do not 
exempliify it for part of the instructional time, llirough their teadiing, 
university profesiors in schools of education cm provide students direct 
experienca with the modeL Their understanding of, commitment to^ and 
practi^ of this model as part of the curriculum for professional educators 
must be provided for in any efrective di^mination plan. 

Teachers and other educators must dso be provided the opportunity to 
observe the model in operation in a variety of public school cla^roorns 
using all the possible options and wiatiom included in the modeL The 
model is not a narrow, ripd sp^iflcation of what must be done in dass^ 
rooms* It ^ows for a variety of possibflities in a number of iti compo* 
nents. Educaton must observe ^ these po^bUities and their interactions 
m part of the profe^ional curriculum to avoid the notion that there is 
only one way to implement the BTES model. 

Fin^y, the professional educator must have an opportunity to practice 
using this model with the guidance of people who are knowledgeable and 
experienced with it in a variety of settings* As educators receive direct and 
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immediate help m diapioas, prescription, feedback, and monitgring in 
differini lituaiions, the model wfll become a meanin^ul part of their 
profe^ond repertoire of sWls and taowledge. 

'Die beha^oml conceptuaUMtion of curriculum, made more precise by 
the BTOS study ^th all its complexities, streiigthi, and limitations, rfiould 
be one major component of profe^ional education at any leveL It should 
not be the ordy model, however. Others ^o exist, and more undoubtedly 
be developed in the ftiture. How they can be used to help thieve 
curricidar goals also must be a part of any teacher education curriculum. 
As part of their professional preparations educators need to be made aware 
of aB aimflable resources tlmt can help them meet the demands and prob- 
lems of schooling. Hie con^ptiom of curricidum presented in this chapter 
as well as others developed in the future rfiould be critically examined in 
professional education for their applicability to the problems of sdiooling. 
No one model or conception is likely to help the schools attain all the 
goals and expectations usually stated by those concerned about educating 
young people. To single out one model as the only model to he used is 
likely to exdude some of the expectations we have reprding sdiooling. 

There are many other sWlls, areas of Imowledp, and attitudes needed 
by professional educators beyond those su^^ted here. This dtapter has 
focused broadly on what is needed in planning and implementing curricu- 
lums. Classroom management sldUs, human relations sWUs, and compe- 
tence in subject areas, for exmple, must also be in the curriculum of 
educators. The need for audi a comprehensive profe^ional curriculum 
rai^i an ever-pre^nt problem in curriculum development: how can time 
be provided to teaA what is considered essential? The find report on the 
WTBS states that the model ^dU not be easily or quickly tau^t. And still 
there are other areas of kno^edge, other skflls and attitudes that must be 
included in the presence cuiriculum for teadiers. Whm and v^ere are 
teachers and other profesdond educators going to learn all that they need 
to know? 'nie amount of time devoted to preservice education for teachers 
is vety limited. 

Hub dilemma points up the importance of insemce education and 
paduate work for ad^^ced degrees in profe^ional education. TTie limited 
time that can be devoted to preservice education makes the continued 
education of teachers essential Reiponsibility for this continued develop- 
ment of needed i^s^ biowledge, and attitudes must be shared throu^ 
insendce work in school districts, university courses, and efforts of other 
profesdonal poups. Hus chdlenge rec^ires careful planning and delinea* 
ion of responsibflities among the group who must help prepare educaton 
to meet the problems of schooling. It is an awesome, but critical, task for 
tiie future. 
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A Teacher Implements 
Instructional Changes 
Using the BTES Framework 

Raquel Muir 



Wien BTES bagan, I had been teaching for 12 years m a district that 
had openly and forcefully adopted a policy of individualized instruction. 
Instructional materids, workdiops, and teacher evaluations totally 
embraced the concept of indinduali^ed instruction. From the bepnning of 
my teaching experiince, 1 was expected to create individual learning 
opportunities in all subject areas* Sm^j smallerj smallest units of instruc- 
tion were conadered beautifid and productive. Heterogeneous classrooms 
were established in aU schools to ensure indi^dudized instruction. 

My interest in tile Bepnning Teacher Evaluation Study was initially 
stimulated by the findings of the part of the study conducted by Educa- 
tional Testing Ser^ce. 'Die desipi and instrumentation of the study indi- 
cated that researchers were at last be^nning to recopize the compleritiis 
of teaching and the value of studying normally operating dassrooms* The 
findinp were simply hypotheses to be further explored^ but tiiey offered 
stim^ating challenges for teachers to think about in relation to their own 
classrooms. I was intrigued by classroom practices different from mine 
that were reported to be related to hi^er achievement on standardized 
tests as well as on tests developed for the study. Hie flndinp on the use of 
materials and groupings for math and reading at the second- and fifth- 
pades appealed to my common sense* even though some were contraty to 
my practices, As a sixth-^de teacher who had tau^t from grades two to 
six in a variety of combinations of grades or ages of pupfls, I was com* 
fortable in considering that fifth-grade practices could have a logi^ ex- 
tension for sixth'grade practices. All the fmdinpj combined with my 
active interest in educational experimentation and changes led me to 
follow the study with increaiing interest. 
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Research In Real Cla^rooms 

Hii BTES dedpi of studying regular classrooms with a full complement 
of students for an extended j^riod of time also ap^aled to me. Having 
conducted a yearJong study vvith a reg^ar cla^room of 30 students 
^veral years before, 1 was well aware of the difflcultles and advantages of 
suoh a research ded^* Th^ thread of common sense and the Edition of 
some Intuitive perceptions about teaching and learning that have been 
around for a long time began to emerge* Some concepts suggested teadiing 
techniques completely opp^ite to the hi^y accepted and endorsed indi* 
vidudized approadi I was using. 

As a classroom teacher I have become increasin^y wary of quickly 
adopting new programs or even new instructional materials just because 
they are "fresh, neWp and appealing." Furthermore, I have been reluctant 
to implement currlciUum propams and their related materials In which I 
have had no opportunity for choice or evaluation* The research b^e for 
dmost all such propane is limited or nonexistent. On the other handt in 
all fairness, my own instructional program was based on the district's 
policy of individualization of instruction and on its deflnition of the 
terms* 

Thi.^ issues raised by the BTES study offer stimulatag challenges for 
teachers to explore while su^esting a tool that can be useful to help them 
monitor student learning on a daily bads, if ^ey so deiire. Instead of 
running counter to intuitive notions of good classroom practices md 
Jmowledge of children and their behaviors, the BTES research offers a 
refinement of the art of teadung^ and encouragement and support to 
stimulate creativity m a teadier. Who could turn down such an exciting 
prospect? 

Soon after my introduction to BTES, I was appointed to the Com- 
mission for Teacher Preparation and Licensing (CTPL) in the State of 
CaUforniE. CTPL was respoMible for developing and administering the 
study as well as for subcontracting for the services of its Educational 
Testing Serviee and the Far West Laboratory for the actual research design 
and study. Becaiige of my interest in BTES, I was appointed to the re- 
search committee directiy involved with the study, 

R^archtn and Teadiei^— A Team 

I hid an excellent opportunity to observe and listen to the researchers 
in action. There were hours of debate between membere of the research 
cominunity on dedpi, vaUdityi and reliability. So many caveats were 
recommended that the research would be ahnost useless if all were 
adopted. It was obvious that the study needed tiie researchers md all their 
Averse vie^ and dedp expertirt» but it became apparent also that even 
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highly respected p^cholo^ts and re^arch teams need teachers to help 
them understtod sonii of the comple3dties and dynamics of a classroom in 
full operation. 

About 1975 my interest in BTES and the emerging experiments became 
so intense that I dedded to ipiore some of the early advice of the research 
ad^ory board and "play" with some of the concepts developed in the 
beginning of the study. In no way ^d I intend to conduct a research 
study; I dmply wanted to take some of the more practicd flndinp and try 
to detenmne if some of the fifth=grade practices would transfer success^ 
fuUy to sixth grade. 

For mij a powerful issue raised by the study was the indication that 
greater amounti of direct instructional time were correlated with increased 
student leaming. As the results began to emerge and the concept of ALT 
was developed J the issue became more complex as it specified pupil be- 
ha^ors and teacher skflls, ITie final definitions of allocated timCj success 
rate, time on taskj and tfie family of teacher practices related to increased 
ALT were less clear and tidy as I bepn to try out some of tiie po^ible 
implications for teachers, I u^d diaposis, prescription, presentationj 
monitoring, and feedback to indi'ddualize my instructionj as I always had. 
How could 1 continue to use these concepts of teaching and ^ve instruc- 
tion to larger poups or ev^n the whole class for math instruction? ITie 
concept of heterogeneous poups versus homogeneous poups emerged, I 
found myself asking questions about and finding a challenge to my style of 
indi'^dduaUzed Instruction, I was bepnnlng to ask: "Is it posdble that 
instruction in maUi and reading may be too individualized? Is it possible 
that there can be a bland of large group or even whole ckss instriiction and 
individualized instruction? Are there elements of individualization that aie 
distractors to time on task, even though they are theoreticdly education- 
ally sound? Have we as educators been sold the concept of individualiza- 
tion too stron^y, to the exclusion of other instructional patterns?" I ^w 
tension and conflict, but also I saw intriguing possibilities. 

The Context of tiie District 

The climate for individual classroom experimentation in 1975-76 in my 
district was essentially neutral* Tlie (mm of administration was on im- 
pending collective bargaining, maintaining individualized instructions 
writing behavioral objectiveSj and raising test scores throu^ specifled in- 
structional propams, I was not able to generate more than mild interest in 
the concepts of BTES. Ifaving been Judged outstandin^y competent as a 
dassroom teacher by the StuU equation procedure, I felt free to experi- 
ment BTES, 

Basic questions emerged immediately. How could I increase direct in- 
struction^ time for everyone in the class? Could I reorganize my math 
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materiali and acquire new technlquas for tiaching the class as a whola at 
the same timg? CoiUd I resolve the conflict between the liiue of indi\dd- 
ualiEed instruction and greater amounts of time on task thfou^ whole 
claM instruetion? How long could whole clais instruction effectively keep 
most students on task? 

FhUo^phioally, I did not have any trouble attempting to increase direct 
instructional time at tiie expense of other activities such as pmes or 
unrelated center activities at the mxth pade. My observations over the 
years have suggested a strong correlation between academic competence, 
self^concept, and a liking of schooL In additionp my experience has been 
that students with stronger academic sldlls have tended to be more sdf- 
directed and often have helped to chart some of the leaminp for the class, 
BTES suggested to me that if I could increase students* learning throu^ 
more ALT, perhaps I could also have some influence on self-concept and 
attitudes toward school, as well as on arademic competence. Despite all 
the caveats on ALT, I decided that it was terribly important for me to see 
if I could bring any of this about in my classroom, I simply coiUd not wait 
for evetyone to agree to disapee or a^ee to agree on tlie research and the 
final findings. 

The Exptriintnt Begins 

I began my experimentation with some ideas emanating from the re» 
^arch in midwinter 1976, ITie class was composed of 32 students-20 
boys and 12 girls. ITie school population was dra^^ from a middle- to 
low-income area with full intepation of aU minority groups. Achievement 
ranldnp of the school were reflected in my class and were below grade 
level at least 6 months to 2 yea^ or more for both reading and math. The 
^hool had the Early Childhood Education project and the Title VII Bi- 
lingual project, but the upper grades (4 to 6) had no project, no aides, and 
no funds for supplementaiy services or materials. 

Allocated time for math was 60 to 70 minutes per day, vdth a success 
rate ran^g from 40 to 80 percent on moderately dlfflcult materials. I 
devoted a minimal amount of time to reviewing concepts except through 
cumulative teachemade tests, which I gave approximately every 2 weeks, 
"niere were Ave math ^oups based on concepts and skills plus three 
students whose skills were not suitable for any of the established group, 
Th^m three were on separate tracks with special materials appropriate for 
tiieir levels— all low. My observations of the students' time on task mthout 
direct instruction was embarrassin^y low when I focused my attention on 
that facet of my program^ Transition time between groups was often slow, 
and it generally disrupted the entire class when one poup moved around. 
However, the students worked weU with me for group instruction and for 
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about 10 to IS minutes after thalf return to their own seats to do tiie 
foUowup asspiment^ After that time had elapsed the class was not neces* 
saiAy nomyi but I observed tfiat they were often not angapd in math or 
acadetmc tasl^. It was ob^ous the period was too long for some, yet how 
could I have mi$^ poups and get to each poup any faster for any Idnd of 
mewingful instruction? 

IWs particidar class had 20 boys who were very active. Severd had 
phyaicaUy aggresiive behaviors. Discipline problems with several of these 
students were frequent when I was not vi^orldng directly with their pMticu- 
lar poup. 

llie class coverage of thi math ourriculum and the level of competence 
was sufficiently advanced by mtdwir^ter that it appeared a good idea to 
imdirtake the new instruction^ psttem using a rertew of concepts. 

I explained to the olm abcut the ro^arch being conducted and why I 
wanted to try a new way to teach matli, I lu^^ted it nti^t even be more 
fun for them. As a dais they agreed to try out the chanp, ^d we dis^ 
cussed what would be the nece^^ behaviors for eveiyone if the plan 
were to work. 

^e fmt few days of the 45'minute tea^er^directed instructional time 
wWi 10 to 15 minutes of independent followup were dramatically success- 
ful. Behavior problems disappeared. Everyone appeared to feel chdlenged, 
yet not overwhelmed, AD ^e students were working on materials and 
concepts that were mtiun their capabilities for a^emg hi^ success or at 
least some success for those with few mastered concepts. Hie diaQange 
was not only for the correct re^onse to a problem^ but speed and 
accuracy to tiie best of each peon's ability, I responded with above 
average amounts of poritive reinforcement because I felt it ^s truly 
earned. An indl^idud recopiition tystem for effort and **being on task" 
began to evolve, 

I found that, as a teacher^ I was concemed with presenting the concepts 
and giving poative reinforcement for the responses I wanted from the 
students in terms of effort and accompli^ment. But I also had to be 
hi^y sensitive to the physical md emotiond baha^o^ of the dsm. At 
first I was only remotely conscious of ALT m a concept. Instead, I was 
busy with my sensiti\dties tomrd how many students were worldng. How 
long could I keep on with the concept and how many examples did we 
need to compute to make certain the concept was learned? How success^ 
fuUy was each student leaming during the lesson? I have heard from other 
teachers that teaching the whole cla^ is the style for the teacher who does 
not mnt to work too hard. I found the absolute opporite to be true, 
Althou^ it was exhilarating for both the class and for me to experience 
Ae feeling of everyone working independently, yet together^ like an 
orchestra} it was tiring— no^ exhausting* 
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Ftmh Indghto on InitruQtion 

After about 10 days of new pattern^ the ehUdren bacima aware that 
they too were coveting more material and were working harder and longer 
than they had under the previous pattern. Some children in the dower 
groups who had been on indi^dualized propams most of their lives 
worked harder th^ I had ever seen them work. Hie opportunity to do the 
^me work as ^e whole dass seemed to moti^^te them. Althou^ their 
speed and aceuraoy were not as hi^ as those of most of the class, the idea 
of flying with the whole class seemed to keep them trying* I had expected 
some students to beaome bored with the practice material and the re- 
viewing of concepts^ but they appeared to respond to the challenge for 
speed and accuracy. Many expressed pleasure as they could see their in- 
creased speed md accuracy in computation. Other children said that they 
Uked the new plan because it pve them a chanp and a chance to practice 
skills so they regiiy understood what they were trying to do. Many showed 
a wdUinpiess to stiggest topics they would like to have re taught. With 
encoumgement from me, die students helped chart their needs and instruc- 
tional tasl^ and mdicated to ma in a variety of ways that it was tLme to 
move right along. 

The ConfIiat--Indivldualizad and Laise Group Initniction 

On the other hand, lest the reader think that aU was sweetness and 
U^t, there was a ^omng resentment within the ranks of the students that 
the amount of time they were being held on task for math was too mudi* 
Hie number who grumbled and resisted and verbaUied was smaU, but they 
became clearly disruptive for the instructional period. Hiey missed the 
opportunity of "messing around" when other groups were meeting. Some 
did not experience the success rate they wished to achieve (100 percent all 
the time with little or no effort). Some simply did not want to ^ve up the 
smaU poup instruction and the comfort of being able to ask for help with 
only a few other students knowing vAi^t they did not know. 

StUl, at the end of 2 weeks I would have said that the new plan of large 
group instruction was a success and was here to stayi Hie students' time 
on task as a whole cla^ had increased. Hie room was quiet and intense 
with the atmosphere of effort from eaA itudent— an en^ronment teachers 
reco^ze and fmd rewarding^ "^e environment was serious, with even the 
'^class down" involved^ I^e spirit of cooperation appeared conta^ous. It 
was as thou^ the same behavior patterns present for smaU poup instruc- 
tion around a table existed for everyone bi the classroom^ With the large 
group instruction, smdl groups no lonpr had to move to the instructional 
table for instruction^ as before--one less d^tmction for ALT, 
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Ilii tindons bitw@in group ind large poup instruction bigan to 
emerge as we moved into new coneapti to be leamad. Within the hetero- 
geneous classroom range in readmess for sequential concepts was peat. 
New laammp were too hard for tho^ ^thout appropriate maitered skills. 
For tiiose sdtii advanced sfcHlij tfie pre^ntallons necessaiy for large group 
instruation were lometimes too labored and long* ITie students began to 
e?dubit impatience vdth the pacing. I ^scovered I changed my teadiing 
style as well as materids and concept in sm^ poup instruction. WhUe 
larga poup instruction offered the advwtage of monitored practice on 
Vising levels and introduced concepts, smaU poups dlowed me to be 
flexibli in pacmgp style, and level of concept difflcidty. 

Experimentation with the whole poup instructional pattern pve me 
some indication that I coidd move throu^ concepts faster than I had 
QOvli ^ve peater amounts of spaced practice for mastery of the concepts, 
once they had been introduced Mth small poups. Removal of distractions 
such as poups movmg to and from centers or poups enppd in activities 
not direcdy related to assiped math work increased the totd time on task 
for the cla^. My availability to move about the room to reinforce on-task 
behaviors and to proWde immediate feedback appeared to increase ALT 
and served as a peat motivator to students. A general procedure of leading 
the large poup throu^ sequential problem-soMng operations vdth 
assipied practice material at m appropriate level of difficulty appeared to 
be a successftil teaching strategy. It enabled me to g^ve frequent feedback, 
even for a small numbef of problems for each student ^ an important advan- 
tage. SmaU poup instruction did not lend itself to this same kind of 
immediate feedback except during the time that I was working ^th eadi 
poup. 

I experimented Mth difFei^nt levels of instructionj different p^itive 
reinforcement techniques, alteration of the allocated time for m^th, style 
of presentation, diapiods of $mh difld's level, and whatever variable ap- 
peared to intervene on the scene that seemed to change day by day. ALT 
swung from a dramatic hi^ to a dramatic low about 3 weeks after the 
outset, 

I was laaming! An "either/or" attitude on my part-either completely 
individudized or all large poup imtruction— was not necessary, Tliere were 
advantages to boUi patterns, I bepn to seek a way to use the best 
strategies of each. Gradually, as I altered the pattem once again, ALT 
began to increase aga^. 

The Comproniisa 

It ymu apparent that I could not hold the entire class for the entire 
math period eveo^ day, I decided after the 4th week to shift back to the 
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small groups for 2 or 3 days per week and to use the total class instruction 
for the remalndir of the week* 'Die smaU groups were reorganized, but no 
one was on an individual program, I established a pattern of testing that 
was a bit different from the previous model, Every other week each group 
had a different teachermade test^ and every 3d week the entire class had a 
new teadiermade test that was a comprehensive review of all concepts 
taught previously both in smaU group and whole class instructional 
periods. I^e pattem began to emerge as a happy compromise. Total class 
instructional periods were pleasant but intense^ with high ALT, Smaller 
poups appeared to meet the individual needs and were helpful in covering 
concepts initially, ALT was high within the instructional period, but ALT 
for independent seatwork dropped at times without my monitoring time 
on task except from the instructional area. 

Appropriete Materials 

The greatest difficulty I faced was obtaining materials in sufflcient 
quantity to be useful for the entire class at levels appropriate to obtain 
high success rates. If the tasks were too ea^, the material did not seem to 
encourage adequate effort and carelessness developed. Obviously, the 
opposite was also true, but for different reasons: if the tasks were too 
hard, the students simply either guessed wildly or made no attempt at all. I 
tried to avoid this mistake. The children fmdly accepted my frequent 
admonition that it was "okay to make a mistake, but not the same one 
over and over." A few mistakes were ^ right while learning was going on, 
but too many perfect papers apparently said to my students, **rm doing 
this so well I don't need to work very hard at it. It is so easy I won't try'' 
In my classroom the highest level of engagement was produced by work of 
medium difficulty, with occasional hi^ difflculty work to whet their 
appetites to leam new things. 

Attitudes toward math were far better for this class at the end of the 
year, TOe students made exceptional gains in math on the year-end 
achievement test in May, Needless to say^ they were delighted with them- 
selves* TTieir behaviors and attitudes toward math had changed a great 
deal, I had changed the structure of the math instructional program and 
was confident and comfortable that the students were learning more, I 
thought consciouriy about ALT and how to increase it for math. 

I was pleased to have experimented with the BTES conwpts in math, 
ALT had not evolved as a named concept, but I had proved that I could 
increase direct instructional time for math. However, I also knew I had to 
be ready to respond to class needs, interruptions of schedules, and other 
variables. 
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Same Tima Next Year 



My mxt dass eonslited of 28 students— 19 girls and 9 boys* Tlii ©co- 
nonue and ithnic balance of the dais and sdiool w%b ^ftlng to mom 
mmoritiii and a rapid tumovir of students during tiie school year, Hus 
tmiovir was a marked dij^rture from the past for my dapes. Hii prls in 
the ekss did not like math and said so at the beginning of the year, Ha^g 
survived tfie year before witfi the new pattern of math instruction I found 
it far easier to use at the be^uinlng of this year, ^ds group did not have 
the opportunity to discwi whiter they wanted to undertake a change. I 
set standards for effort and b^a^or cooperativdy mtii the class because I 
wanted to start this ^up with the new procedures m their accepted 
method* Moweveri I definitely guided the resulti. ALT increased as the 
standards wera met. Wiiti a peater amount of ALT» content and coverage 
were faster. By midwinter the ^Is almost ^dgbigiy stated their opmion 
that "math is reaUy fun^ and I can do it better this year," ^Me the 
procedures were easier to follow than the lit year, I found that my own 
tasks of remaining ^nsitive and responsive to the pupil behaviors remained 
as criticd for this class as for the previous one. 



Trial and Error Crucid 

I made some of the same mistakes again by having ex^ctations that 
were too high for some of the class. What was fun one week was diffic^t 
and a chore the foUowing week. Breaks in instruction due to my absence 
from the classroom to attend CtPLmeetinp caused radicd swinp in ALT 
that ware more severe than thc^e of the prewous year. Even so, math gains 
for tSm duu on die posttest adiievement tests were significantly greater 
tiian the gains of the pre^ous year's cla^. Attitudes toward math con- 
tinued to improve and were dl positive by June. Coopemtion among die 
children and with me was in much greater evidence ^th tfus group than 
the first class* 

Altfiough I have no concrete cadence in tem^ of docked ALT for 
individuds or Uie whole class, my own observations showed that I dramati- 
cally increased the ALT for matii for this class, ConMnents from the prin- 
cipals and other teadiers entering the room during math instruction were 
complimentary, md ^ey frequentiy expressed amazement at how hard 
everyone was worldng. These comments seem to indicate that high ALT is 
the student behavior a teadier is expected to deliver. How or why students 
may have extended periods of ALT diould be of prime concern to teasers 
^d administratori. 
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I^a Reading Experiniint 

After sevird wet$t$ of sdiool I diapiosad the reading needs and abilities 
of thase 2d-year B1 6S itudenti, I decided to experiment igain with this 
dais in m effort to raise ALT for reading. You must undej^tind that I 
have a short memory and had alreidy forgotten the trauma of die pre\1ous 
yeir with math. Reading icores were below gride level for bII the sixths 
^ade dasies, Tlif reading propam followed in my school and in most of 
the district mMqq^ is mandated by the district. It is a primao^ propam 
that Itai hmn extended to dl six grades for implementation. A reading 
speciaUit is assigned to each school to help maintain the propam In all 
classroomi as well as to offer tutorial reading instruction to those pupils in 
the lowest quartile on itEndardized achievement tests. 

Promidng teaching practices reported in BTES in 1976 su^ested that 
for flfth-pade readings greater emphaiis diould be placed on comprehend 
sion than on basic decoding skflls and word conflguratlon. Sustained inters 
action between teacher and pupU around fewer instructional materids was 
suggested as another promising practice. Fifth^grade reading instruction 
^ould be desipied to require the use of more complex thinMng processes 
in comprehension activities using fewer materials. Continuing to assume 
that it was reasonable to expect that sixth-grade reading practices were 
closely related to fifth grades I began to redesipi reading instruction in my 
classroom. 

Hie reading propam in the diitricL was coniidered to be hi^y indlvidd 
ualized. It consisted of a word configuration component (word 
recognition)^ phonics, comprehension^ and oral leading. Each student was 
assiped to a basal reader appropriate to his or her reading level. Enrich- 
ment was horizontal, not verticalp with supplemental activities at stations. 
Station 1 was with the teacher, station 2 was the independent foUowup, 
and station 3 was an an opportunity for reinforcement through use of 
games. Almost aU classrooms at the primary level had aides to ^sist the 
teachers. Upper grades had no additional support perionneL A wide 
variety of instruction^ materials was available and was used in the cl^s- 
room in both priman^ and upper grades. 

In an attempt to focus mo^ mstruction on reading comprehension - 
activitieSi I eliminated station 3— the games and audfo^ual activities. 
Heterogeneous abflity groups were formed and met with me at the instruc- 
tional center for at least 20 minutes each day. Ml other students remained 
at their own seats with independent a^i^ments. As in math, less physical 
movement within the room resulted in using less time in tmndtions from 
station to station. In addition, pmes and audiovisual acti\dties had been a 
con^stent distractor for students at other stations. For upper grades, this 
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station 3 aoneept was ^awid by most tiichem is a ditamnt to reading 
imtruotion rathar than a fadUtator. 

I dl^Qntinuad conflguntion componint-ttie flaih card techniqua 
for reoogmtion of words. Tima for phonic instruction udng nonsinse 
words was aUmlnatid for aS studfnti uuUasi it was ob^oui that a student 
had mlsiid aU tha pravious prirnai^ and middli pada phonics uiitruotion 
and had no word attack skUs. 

I foeusad almost aU reading instruction on comprahansion activiti^. 
Again looldng to the rasaarch as a ba^i I estabUshed a pattern of instruct 
tion that made it po^ble for me to prescribe, monitor, md intaract ^th 
each student on a dafly baA. I astabU^ad a contract ^stam for inde^ 
pendent raading acti^1tias« A pattern of revolving comprehension groups 
evolved as I obtained imtructional materials mth a ranp of difflc^ty. I 
monitored all propams and wm able to intaract with the students concern^ 
ing the raa^g concepts. In addition^ the materials thamselves providad 
immediate faadback for the students. 

Tbm instfuctional pattaro was considarab^ Afferent from Uia district's 
leading propim« The students eagerly adopted tha naw plan; perhaps they 
were tired of the pre^oui ^ogramj dnca it had been their sole ^ttem of 
feadfaig bstruction dnca ^e first grade* It was neoassaiy to ^tabUsh' co- 
operative standards of b^avior for thi wading ^riod, but as we openly 
discussad transition times ^d behaviors, tha tmnsition times between 
poups and subjects (bopped to 1 to 2 minutes* Moritoring ALT on the 
bistructiQnal materials became much eader as the moods of the class 
Aanged« I loiaw the Idnd of ALT I was seeldn^ Once the children expari^ 
enced the feeUng of success^ th^ also appeared eager to capture it agdn 
for themselves* 

Stadant Coopemtioii Critical 

This clais bapn to talk about their need for superior claMroom co- 
opemtion and beha^ori that wo^d dlow each panon to work to his or 
her fullest abflity. '^y claarly wanted an environmant that was quiet yet 
ralaxad enough to move about to gat needed materials and/or help. As the 
year prope^d the self-direction of many of ^e students became more 
apparent^ whether they were working direcdy with me or In their individ- 
ual areas. 

I astabU^ed study carrels for each pair of students, mlng cardboard as 
dividers or waOs, I prodded bookands for aach student, to house my 
overflow of bool^ th^t v^uld not flt into the desk. Hie students paperad 
the di^dan in wallpaper of their cjioice; some brought d^k equipment 
from home. The en^onment was busines^e^yat pleasant, persond, and 
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rd^td. Eieh pai^on had t plaea of his or har own for study, itlativily 
ffii from typical daisroom dIstraQtions, 

Students, Tmt Scom, and Ftt dback 

I hild parint-stud§nt-t§ach§r confirinces to go ovar the quantity mi 
qudity of the studinti" d^y work, I ineludid the child in thi t jnfirgnce 
m m iqud partnir m raviiwing the work* All wre interisted in leaming 
how they did on the standirdizid aehievgmint tarts. It was the first tima 
tiiit many had avar redly loiown how thay had pirformad on such tests* I 
disoussad tto eoncept of ALT— without using its name— with tha parents 
and tiia ohildran. Masons for tha room envlronmant md tha group 
icti^ties appear d to ttka on new maanuig for all concemad. 

My experiance with ALT for botii raadtag mi math for this elais was 
positiva. Althou^ I had no ddas or aMistants to help with the implemen- 
tation of the propam, this Qlnm had substantidly ini^asad the amount of 
Aoadamic Leaming Time within the aUocatad tima for reading and math* 
Further, as a p^oup, they felt good about themselves and school and 
looked forward to entering junior high sohool* Many have retumad to 
dmra mth me their suecesses during the eurrent year* 

After I had scored their annual adUevement tests in late May^ I agdn 
conferred with each student I pve tiie students their test results and 
^owed what g^s or losses they had made. 

An interesting spinoff of tUs actiwty occurred that had a direct effect 
on tha ALT for boUi reading and math. Because most students were very 
pleased with their improvement on the tests, they said they waie pleased 
to have learned. They abo said they were tired of worUng so hard for so 
long. 

It was time for a chanp of pace, I had a choice to makCp because ALT 
for reading imd math had become lower after tiie feedback than at my 
time during fta year* Typicd reinforcement activittes no lonpr produced 
results. It was apparent that I could apee with them and respond to their 
concams vwth leamin*| acti\rtties different from the pattern we had 
followed throughout the year, or I could try to insist that we follow the 
regdar routine to tha and of school and take the ^ance that ALT would 
skid out the door* 

ALT as a Tool 

I had learned another mteresting variable for maintaiiiing ALT. Giving 
too much feedback on student perfomianca on traditiond posttests- 
CTBS In my district^^uses students either to become discouraged mi 
fiM of despair or to conMder tfiemsdves m ha^g ai^aved more than 
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mffi^mt learning for the year, lliiy gmduate themselves! ^en this 
oo£iu^ ALT plummits if the same instructional program e^tinues. Many 
redsted mort comprehension migiunents in reading. Independent free* 
ranpig libraiy rea^ng alone produced high ALT during Uie last 4 weeks 
of ^ooL Perhaps tMs is not all bad. I responded witii a variety of differ- 
ent aotivities. itad I Qhoien to the ALT for these aott\itieip it would 
have been high, Th% power of ALT as a tool to measure learning, whether 
extemally ineasured or not, beoame more and more ap^ent. If It is used 
to hdp ei^uate and monitor aoademia subjects, the term ALT Is probably 
appropriate. If, on the otiier hand, it is used to help evaluate acti^ties in 
the affective domain it could be equgQy valuable under the title of Active 
Leaming Tim@. I thbk and use the terms interchangeably. 

ImpUcationi of ALT 

An Unanswered Question 

The response of the second cla^ to increased ALT led me to another 
unsolved question that research had not yet addressed. Is it poMible to 
increase ALT to sudi a le^l that it could be a neptive influence toward 
school attitudes? By being perceptive to Ae dianges and behavion ^d 
moods of the eteis, I was able to see that iny instructional propam needed 
to be chanpd for the last month of the school year. I decided that the 
posdbflity of too much ALT was another variable that needs serious re-^ 
searclL 

ALT— An Unshaakling Idea 

I view ALT wd the BTES as tools that su^st practices to be used by 
teacdiers in an individud manner to further the art of teaching elementary 
chfldren. In no vmy do I idew the study or findinp as a prescription of 
what a teadier ou^t to be doing in a classroom. If an entire factdty could 
view the isiuei raised by the study Md appUcation of ALT, md apee to 
experiment within their o^ cla^rooms using their o^ styles, the expert-^ 
^ce would bt productive for education^ 

The implications of ALT indicate some neoessaiy self-^e^uations that 
must be made by teadierSp Hard questions must be honestly answered if a 
teacher is to experifnce success ^th ALT, Can the teacher accurately 
diapiose indi^dual student needs and level of skills? Is the teaoher^s sUll 
at prescribing leaming actiidties sufficient to ensure an orderly presenta^ 
tion of sldUs or ch^enps to the students? Is it posmble to monitor closely 
Uie students- leai^ing on a dafly bads? What ^ds of ^anps in presenta^ 
tion would be nece^vy if the concepts were to be tau^t to s larp rather 
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than imaQ group? How mueh tlmi is avaflable to Interact with indi^duil 
studints on a dafly baas? How much feedback can be suppliid to tiie 
students, and how fast? 

As an indindud teacher responds to such questions and equates th€ 
p^ram within his or her own classroom, it should become apparent 
whether the basic teaching skQls or behaviors as suggested by BTES are 
present or absent. Only an individual teacher can honestly assess his or her 
Qmi basic knowledge. The obvious implication of tfiese issues would be to 
obtam hdp to develop the sfcUls if they are lacldng, use them if they are 
present (but not being conscioudy applied within the da^roomX or refine 
them furAer if that is appropriate. Certainly toe notion of ev^uating 
teacher on the basis of cla^room ALT observed on visitations by prin- 
cipals should be ^gorously Ksisted, 

Time--An Unresolved Issue 

Later fmdinp from BTES and ALT converge around the variable of 
dlocated time and level of difficulty of materids presented to students, 
Ihm B a great range in mounts of dlocated time for both reading and 
math* Implicit in the eKamination of the amount of allocited time diould 
be the amount of time the students are on task during allocated time. The 
issue appears to be not necessarfly how aUocated time can be increased* 
Despite the current "back to basics** movement, we must remember that 
increasing aflocated time to increase student learning may not be the 
central issuer There may be a maximum amoimt of alloeated time dedrable 
for a class. To go beyond this Umit may be a negative indicator rather than 
a positive one for ALTp Too many variables interfere with a fmite state- 
ment of time allocation. BTES does not speak to this issue. 

Student Success--An Unresolved Issue 

Th§ proper level of difficulty of materials, mth the resdting degree of 
success the students experience remains m open^nded issue. Of ^ the 
variables vwtWn the study, this was the most difficult for me to manage 
over an extended period of time. The research was conducted on the 
second^ and Ofth-pada levels, but I attempted to extrapolate flndinp for 
students at the slxto grade. Althou^ I m% unable to replicate the BTES 
flndinii within my daM, tiie implication that appears to be powerful is 
toat a peater amount of pmctice is appropriate for dl students. How 
much practice and at what level of difflcdty still must be determined by 
the individual claMroom teacher working with the unique group called a 
daM, Related to this issue is the quesUon of the appropriateness of using 
textbooks m the major structuring itatement of the curriculum. Many 
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boate tmy not be supplying adiquate mounts of praetici matirials to 
^luri conioUdatid liaming by studtnts. 

Th^ study indtoatt s that ALT may be a tool to hilp tt aoh^^ obi€rve 
coneunint Igaming raUiar thmi relying solily on itandardiied tasts whosa 
results art no longer ralivant. Tim powar of tlus implication is obvious to 
any taadiir. Th§ opportunity for imniidiatf fiidback and mampdation of 
viriablis by tha taadiar to matt difly cWanps to obtain hl^ ALT 
stimidatas elaasroom taadia^ to divalop and usa ^ of thair profasiional 
sldlli and sanMtlvitiaSt ^^Mi the study was limited to the acadamla sldUs of 
reading and matii, my obsemtlons inthin my own da^room indicata timt 
the u^fulniM of ALT is not limited. It oould supply infonnation on 
studant ^pgement in affeative as wall as goputiva taste, Parhapst in fact, 
tMs may be tha ody kind of ma^rabla leaming tiiat can be observad in 
many self-direotad affective leaminp, Seldmi do the stand^dized tasts 
given in public schools tap midi laammp. 

BTES Makes Common Sense 

Another implication of tha BTES reiaardi is Its support of the 
commonsense and almost intuitiva taadiar behaviors and en^ronmantal 
variables whidi comprise the art of teaching With each increasing bit of 
laiowledga about leaming, classroom teadiers have a rationale for da^ 
fending good current pmctlces md rejecting suggested programs or 
materials not based on rasaar^. Teachers should consider their style ^d 
individud approadi to maintaining or incraasing ALT m a biMc teacher 
acadandc freedom. I laava to the teachar^aduc^tors the implications for 
staff devdopment in the basic teadiar sldUs involved in davaloping ALT, 
md the davalopment of skills for pieser^lce taadiera. TTie implications for 
strong development of sensitivities to the behaviors and silent language of 
students as well as a strong base of cognitive content are apparent; butt in 
addition, teacher need a md$ repertoire of intervention and reinforoa- 
m^t techniques to move toward paater amounts of ALT* 

In addition, if clamoom teachers had bean a\^uating new propams on 
tile basis of thair pa^ond experiences ^th ALT, pariiaps some of the 
presently used propmia and materials might not have been adopted* Th^ 
teacher beha^or variables ^thin the study such as diaposii, prescription, 
presentation, and feedback, as waU as dlocated time and ranp of level of 
diffiQultyt are fine critaria for evaluating suggested new pfopams. 

Our Oassrooms 

Findly, the most general and yet most powerfid implication for the 
Issue of ALT is for teachaii to be able to take back control of their own 
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daOTOoms in an independent, thoughtful, and reipunsible manner, Uiing 
Uie rationale and application of research fliidinpj self-itudy, and self- 
im^ovement of skUls, teachers will be able to resist fads, practices, and 
programs that seem to run in cycles, often counter to commonsense and 
intuitive teadiing experiments, and use instead concepts presented In re- 
search such as BTES. Teachers do need help in learning about such 
research, and about the findings. 

1 wo^d hope that teachers would not wait to be "facilitated'* into 
trying out the issues raised in BTES, I would further hope that administra' 
tors and central office personnel would refrain from checMng ALT in 
classrooms with an idea of evaluation. 

Descriptiv( , Not descriptive 

ALT is a powerful tool, not a prescription for how and when to use the 
tooL ALT as a concept is dynamic and ever-changing in each classroom 
because it focuses on ever-chanpig and growing human beinp. A teacher 
must make constant adjustments in practices within the year as well as 
from year to year. Teachers do make a difference throu^ their sensi- 
tivities and perceptions of their students, as well as with their academic 
taiowledge. ^ly a teacher, a growing human being, can use tools such as 
ALT and utilise the sldUs mentioned in the study to synthesize a program 
and environment that are flexible, personalized, and appropriate for both 
teacher and students. 

In closing, I suggest that teachers *'play- ' with the iisues and concepts 
presented in BTES, Experiment with the ideas and the variables that 
appear relevant for your grade level and classroom. Primary and upper 
elementary classrooms are y&ty different. Measure your ALT and transi- 
tion time. Challenge yourself to increase ALT and decrease transition time 
reprdless of your basic educational philosophy. Interesting changes may 
occur for you. 
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A Principal Implements BTES 



Pamala Noli 



Thm ara two kinds of fools: TTiose who sayj **This 
ii new and thtrefora better" and those who sayi 
"This is old Mid thmfore good," 
- Wittkm Rslph Inge 



From the beginning of my involvemint with the Bapnning TiaGher 
Evaluation Studyg I v/m attracted to the model h>^otiiidzed because it 
reflected some old but, I thought, valid notions about teaching and 
liarmng. They were being viewed, however. In a new and exciting context. 

I had been appointed to the research advisory board as a representative 
of matiiematics educators working at tlie district leveL Ei^tean months 
later my Job changed from curriculum consultant and ECE coordinator 
to principal of two &8 schools in a rural cofninunity. BTES seemed the 
perfect vehicle by which to reach three of my major goals: to improve 
student achievement, to set up a staff development program that fit the 
value system of the facidtieSi and to satisfy the district's need for higher 
test scores. 

During the summer between my appointment as a principal and the fdl 
when I ^mned the position, I set about conceptualizing a staff develop- 
ment plan, I was plagued ^th a number of doubts and fears. Would these 
two staffs like and respect me if I pushed too hard too fast? How would I 
deal ^th teachers who rejected any attempts at change? Wouldn't it be 
better to wait a year until I had hopefully) established my crcdibUity? 
Would I alienate the otiier principals if I was too "png ho" and was able 
to raise test scores to a noticeable degree? Could I cope mth all the new 
manaprial tasks before me and do this too? Could this effort hurt the 
school climate I hoped to improve? Did I have the necessaty leaderdiip 
sldlls? Vnim I realized that these doubts were getting the upper hand, I 
tried to reason with myself on the other side. Hadn't I luccessfully tau^t 
at a number of gmde levels for 6 years and continued to teach in class- 
rooms regularly in evety Job I had held since? HadnH I had lots of leader- 
ship roles at the school and district levels over the past 8 years? Hadn't I 
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spoken aU over the State since 1970 on such topics as individualized 
instructioni mathematics iducation improvemint, and humanistic compe- 
tencieSj and acted as a consultant to a number of other school districts? 
TTiis last question brought my fears into clear focus. Except for my experi- 
ences as a classroom teacher* resource teacher, and curriculum writer, 
much of what I had done in my career had been of the "blow in, blow off, 
and blow out'* nature. Now I would have to live with the results. 

1 remembered something Eleanor Roosevelt said: believe that anyone 
can conquer fear by doing the things he fears to do^ provided he keeps 
doing them until he gets a record of successful experiences behind him." 
Clearly J I had to bepn lest I never do so. I dismissed the waminp for 
caution offered by the researchers on the advisory board who repeatedly 
pointed out that the BTES hypothesis had not yet been empirically vali- 
dated, and I plunged ahead. 

The Qu^rion 

By the end of the first part of the study, a hypothesis had been 
generated that students who accumulate more Academic Learning Time 
(ALT) in a particular achievement area will attain higher achievement 
scores in that area. The model formulated from this hypothesis stated that 
teaching processes, such as diagnosiSj prescription, feedbackp structuring, 
and monitoring, would have a direct influence on ALT, The queition that 
I addressed was simply how to introduce the staff to this concept so that 
they, in turn, would work to increase the students' ALT in reading and 
mathematics in our elementary schools. Time itself was not seen as the end 
in the BTES research, but rather as a means to the end. As one increaies 
ALT one canj as a result, cover more content. If more content is not 
covered, increasing time will have little effect on achievement. With this in 
mind, In all activities that took place, I linked time with content coverage. 



Fall 1976 

The first series of inservice activities was aimed at "unfreezing" Qj^mn, 
1951). I prepared myself by reading aU the available materials to which I 
had access, including works by Berliner (1976-1 978)i Rosendiine (1971, 
1976, 1978), and MacDonald (1976), 

Knowing that teachers are not too receptive to new ideas when they are 
presented at 3:30 in the afternooni I went to the board early in September 
to ask for a weekly reduced day for staff development, TTie teachers 
agreed to add 15 minutes of instructional time each morning (school was 
to start at 8:30 rather than 8!45), and students would be diimisied 1 hour 
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'""^ °" "^"'^'y^' Anocatad instructional ttaa was no, 

J^'^t^ s: "'^"^ 

pracdce throuJTo" thr« '^^^'^ tWs 

and phUosophSl imfuS^wrdiSS^r ""'"'^^ "^'"""^^ 
about how chfldren Lm u . ' notions 

Whin it di« tL «^ t f ^ "'^ '° ^« do In the classroom. 

1 It was Clear that the central eonstruot of the BTES hvnfttj,-,- • 
harmony with the beheft of the ^^t, we movedt^f " 



rooms. My purpose to w^^fnS f "'^ " " 

students °" '""d^'^y 

methodolos.™o toetyLfn'f T"" ,"'«™«'on- I »Plalned the 
proceduresThat would h beforehand so that everyone underatood the 
used w S tS^sT^^LTl S:«llf dataeoaected would be 

hibited by one stulenTo^'l' a^^ *^.«no"nt of on-task behavior ex- 

peneil.llki„g7o a^S^^^d ,ht^^ daenppd (daydreaminft sharpening 
the obser^on I cS^f rtfl* ^"T^ ""^ " I"«>«dlately aftef 
and descS ta 4t? the !^^P*'""* « ««dent was on task 
passed in theltae p^S °f — ■ 

taa^;tlu^';^So;«^;^e'1 ' ""^^^^ 

:irs^^tS=~~ 

receptive. -^^ teicnera who were 

qiUt. aw,„. by this tarta^Sl^?„„?*"'° 

who wrote their evaluarinne ^ ^a^*.' ™ pei^on 

no open host^ w"s Ao^n 

these; "Howwasyo.^ Atx^div^f IIJ*^ 
Side consultant is s^ to^I ^IJT% ° 

ALT is off when m" Noh co«., '° '"^"'^^ "^f your 

nen Mrs. Noh comes m. you guys have had it" (teacher to 
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u 1 that thev were all very apprehen- 

n,atenaU«. I decided to ^^^^'^^ i hoped that after the 

the teachers who J^''"",^'^^ from m and had had 

teachers had received our trust level would 

the recuperative tmie out Pfo^/ed by t ^ ^ ^^gg 
be such that we could proceed agam. My ,j qTES 

the last quarter of school was to share ^^^^^^^^ 

advisory board meetings m ^^e^^, j-day^alrs. I hoped that my 

iL^::m^:^::sha;;^n;^ 



threat. 



t rt the staff returned eager to begin the new year. 1 openly 
As anucipated, the statt reiun j obviously more secure 

discussed my fears of the Prt-ous spr ng 0 was^ o^^^ ^^^^^^^ ^_ ^ 

now) and asked them If '^-y .-^^^^^ ^^We^wlth the apaement 
constructs. Consensus was --^^^ m ,i,,„ooms of teachers 

that ALT data coUection would occur orUy m ^^^^ ^^^^ 

who volunteered. Four ^^^of ^ ^^o^ _^^^g^^^^ ^^^^^^ 
included S-minute bramsto^ng js^on _ ^^^^^^^^ 
relative to one particular f«^V^f .^"niques using aides and parent 
transition times, ^-P™ ^ ^o cope with the state 

volunteers to Increase ALT, helP'"! ^t""" * . techniques. The brain- 
of being "stuck." -f^^^^^Z^^on groups to 
storming was foUowed by f 8"deleve . 
identify -dM^orate on theid ^ w^hs «m^ individualized 

S=n ^ !ea— eS^- - ^ ^ " ' 



Spnng 1978 mms had surfaced and some were being 

By February, ^'^"^[^^^on^ data on students as I 
taplemented. I agam ^^^^^^^^^ the teachers further decreased 
had the year b^J- ^ ^^^..^lons from me and were secure m 

^^^^^^ ^i^i^m^:^ 
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doctdral program if I chose to pursue ALT as a dissirtation focus. One 
more teadier voluntf erad for cls^room data collection. 

In late Februaty, an experimental intervention study was published 
which Berliner (1978) and members of his research team had designed and 
carried out. Although all Uiree researchers were excellent educational 
psychologiits and research methodologisti, their elementary school experi- 
ence was limited to their classroom observations. 

Each week during inier\dce meetinps I shared with the staff parts of the 
four interventions which had been carried out to improve ALT. Together 
we analyzed and critiqued each mm study for better strategies that could 
have been employed in that environment. By tlm time, the teadiers felt 
that they had a good deal of expertise in the area and were satisfled that 
tiiey coidd have done a better intervention than had the "professionals" 
with a national reputation* At the same time, I was iharing with five of 
them their own ALT observational data which demonstrated considerable 
improvement over the previous year. We also shared tWi improvement 
^th the rest of the staff. F^Unp were much more positive. 

Fall 1978 

Although the final ph^ of the research had been completed the pre- 
vious springi I had decided to withhold the results until the f^ when the 
teachers would return renewed, refre^ed, and responMve. At an early staff 
meeting I summariEed the final results. Some expressed relief that the 
Aeory we had pursued for 2 years had been empiri^y validated, and I 
certainly concurred, Othem said that to them tfie And report was im* 
material. TTiey knm^ from their own experience tiiat increased ALT made 
a ^fference in student achievement and that if the research hadn*t con- 
firmed it, the fault was in the methodolo^. As proof, they offered the 
previous spring's standardized achievement test scores, whdeh were the 
W^est ever achieved by the ^hoors students, I cautioned them not to 
jump to such conclusions based on test results, since we hadn't controlled 
for other variables (the methodolopsts on the research advisory board had, 
by this time, educated me about the complexity and inadequacy of most 
social research deslpi), but I was secretly pleased that they perceived a 
correlation^ 

One of the findinp that we had not anticipated was that hi^ success 
rate, rather than medium success rate, would enhance achievement, ftir 
working definition gf ALT had been the amount of time students were 
enpged mth materials of intermediate difflculty. Debate ensued over this 
point because much emphaas had been placed on indindual diaposis and 
prescription which resulted in teaching chUdren at a level where errors 
were to be expected. Were we now to assume that all materials were to be 
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at such a low livel that aviry child would get 100 percent at every turn? 
We reached the conclusions that the dlrict instruction level must be one 
step beyond the point of previous mastery and that errors at this level 
were to be expected; that teaching should continue on the objective untLl 
low error rate was predictable; and that practice with the learning, when it 
became easy, was important for evaluation* riinforcement, and trans- 
ference. Wi felt that the practice could best be done through homework* 
thus not retardinithe content eoveragi potential. 

1 offer the above discussion only as an example of the type of dialogue 
that can occur, not as the correct Interpretation of the implication of the 
high success rate fLnding. We have reached our conclusion, however, and 
action on the part of teachers is occurring* particularly in the areas of 
homework and parent education. 

In retrospect* I can see that my ori^nal fears were exa^imted but 
nQnetheless useful. They made me more aware of my actions and sensitive 
to the concerns of the others ^th whom I worked. 

The respect and liking had to be earned over time, but would never 
have been achieved had I abdicated to maintaining the status quo, **Han- 
dling'' teachers who resisted change was difficult until I realized that we all 
learn* change, and grow at difftrent rates and in various ways. No amount 
of pushing, power* or "handling" wiU make a difference until teachers 
have to work individually, within their own value ^sterns. 

My fear about the other principals was warranted* but for other 
reasons. They were concerned that I would receive more favors from the 
district office because of my previous 6 years there. It took almost 2 years 
for those anxieties to diffuse so that I could become an accepted col- 
league. They did not even notice the test score shift. 

I found that with the help of a super^secretary I was able to cope with 
the building-type management responsibilities and still have time for the 
more important functions of the principalship* including staff develop- 
ment and process evaluation. Time management continues to be the key. 



Some Specific Changes That Occurred 

TTie prevdous sections of this paper review our chronolopcal involve- 
ment, I would now like to move to some specific flndinp of the study and 
share an outline of what we did with regard to each. With the exception of 
schoolwide orpnizational changes* each teacher had the option of ac- 
cepting or rejecting the implementation activities. No single teacher 
adopted all of what foUows* but neither did any one teacher reject it 
totally. It is important to keep in mind that aU actions came from the 
staff. My role was, and continues to be, that of facilitator. 
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1. Studfnti who havf longer piriods of tima available for instruction 
in a partici^r content aria also bam more in those conttnt 
areas, ^ 

IL TTie day was extended by 15 minutes. 

b. Two morning lO-minutf ricesses were cornbined into one 
20-ininute recess, thus reducing transition times. 

c. ramaiy teachers initiated extended day sdiedules for small 
poups of children. Since room was available on the 3'30 bus, 
trmniportation wis no problem. 

d. A project was %^tten and ac^pted to employ after^diOQl md 
home tutom uffliring funds from CETA.^ 

e. Transition times getting in from recess and lundi were re- 
duced. Movements from ffoup to poup or station to station 
were streamlined, 

2. Students who attend to their instruction^ tasks more often learn 
more than students who attend to their instructiond tasks rela- 
tively Uttie. 

a* Qassroom disruptions have been cut to a minimum* 

(1) Public address announcements are limited to the flrit or last 
10 minutes of the day* 

(2) CustodianSs resource personnel, secretaries, or the principal 
enter rooms only at normd trandtion times unleis there is 
an emergency. 

(3) Students leaving d^m for music^ speech, and so on must 
keep their own schedule and leave quietly. E^t and reentry 
times are schtduledj as often m possibk, to occw at natural 
transition times, 

(4) Early in the year, simulations and role-playing acti^ties are 
carried out so that ^Udren not be drawn off task by a 
classroom disruption. As an example, two childff n simulate 
an arpment. t^e class is told that it is okay to ^eck out 
what is banning (they would regardless^ but they are 
expected to pt back to work immediately, even thou^ the 
argument may continue. Hie scene is played out and the 
children practice the desired behavion. 

b. On^task bihavior Is rewarded in various ways, 

c. A sustainid silent reading program is carried on evety day 
from 12:40 to liQO, Eve^one in the sdiool (students. 



IaU ^ven of these statiments vimm taken froni the draft BTES Tedini^ Report 
(sm BibUopaphy)^ 

^Compnhtnslve Employment Training Act 
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teachirs, aidas, sicretaries, custodians, and parints) reads 
iomething of their choici in the claiirooms* Tht phone is off 
the hookj the office is locked, and a sign informs nsitors that 
they wdU be helped at 1:00, but in the meantime they are to 
take a book from the stack outside the office door and read. 

3, Students leam more when their teadiers are skflled at reco^ang 
the speciflc strengths and weaknesses of individual students and 
assign tasks that are appropriate to the needs and levels of readi- 
ness of indindual students. 

a. Inservice education was provided on diaposis and prescrip- 
tion. 

b. Learning modalitiei will be explored this year. 

4. Student engagement rates are hi^er when students are involved 
in more cademic interaction with the instructor. Enpgement 
rates ai jgher in a group setting than during independent seat* 
work. Engagement rates in the seatwork are higher when students 
receive more monitoring or help from an instruetor. 

a. Paid classroom aides are trained and used as instructors. Ilieir 
3-1/2 hours per day are spent totally in tius role under the 
direction of the teacher* Clerical tasks, including record- 
keeping, paper corrections, and the Uke, are done by two 
8-hour aides who spend their afternoons so engaged. 

b. Parent volunteers and cross^age tutors work predominantly as 
monitors, helping the students assigned to independent seat- 
work or cenlers. 

c. Multiple-response techniques arc utilized regularly when work- 
ing with groups, especially at the recall levd. One staff devel- 
opment afternoon was spent making individual 12" x 12" 
chalk boards for each child. Students bring fuzzy socks which 
serve as their erasers. VWien the teacher asks a question* every 
child responds on his chalk board. The result is a much higher 
enpgement rate lin^ every student participates every time. 
The teacher is better able to diapiose the group's learning and 
pace the le^on accordingly. 

d. "Independent" learning centers are monitored by cross-age 
tutors or parents unless the station has an audiovisual focus of 
interest such as a tape or fUmstrip. 

e. Indivldudlzed ^If-paced instruction done only with small, 
monitored groups. Self-directed kits and propams such as 
SRA, SWRL, IPIj or Bamell-Dsft are never used with the 
whole class, because monitoring and immediate feedback have 
been found to be extremely difficult when tiiQ adult/itudent 
ratio drops below 1:10, 
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5. Studint enpgement rates are hi^er m elassas whf ri there is a 
clear focus on a^demic achievement as an irnportant goal of 
schooling. 

a* All aradimic *'down-to-buMniSs" atmosphere sets the tone in 
most cli^rooms during rcaduigi mathernatici, and languagi 
instruction- TOs dt^s not preclude student cooperative proj- 
ects in centers, for instancej nor does it mean that motivation 
and excitement arc stifled. Academic achieviment is expicted, 
and students are held accoimtable. 

b. Teadiere structure activities so that studants underitand what 
is to be learned during a pven period and what beha^or is 
expected. 

c^ Afternoon t^riods foUowing the silent reading period va^ in 
their forms but include activity-oriented subjects sxich as social 
^ienee, health, science, and physi^ education; creative 
activities such as art^ music, and drama; and affective activities 
such m magic cirde, centeringi and values clarification. 

6. Students learn more when they receive more frequent feedback 
about whether their responses on academic tasks are right or 
wrang. 

a. Multiple'response activities dlow teachers to give feedback to 
a number of students on each question. 

b. Sm^ groups wth a monitor are receiwig much moie indi\id» 
ual feedback than is poMible with other pouping arrangements. 

c. Self-correction of independent seatwork is encourapd, but 
paperi are ^ot-checked by an adult so that the teadier can 
respond with direct instruction to any chfld who is experi- 
encing difficulties. 

7. Students learn more when the classroom learning environment 
amphadzes cooperation and student responsibility for academic 
tasks. 

a. Stratepes to promote cooperation and responsibflity \at11 be 
one of our focuses in staff de^lopment this year, AJthou^ we 
have not discu^ed this as a ^oup^ I have observed many 
unique approaches in the classrooms and feel confident that a 
little brainstorming and a lot of faring will help to foster this 
goal. 



Concluding Hiou^ts 

I have referred to the ideas genemted by BTES as a framework^ and it is 
m a framework that BTES has greatest potential for staff development. If 
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±3$ framiwork fits ^urily and comfortibly on the foundation of biliefs, 
viau^ and pfiiral philosophy held by the staff, work can bepn on the 
supetftrueture. As the building t^es form, its uniqueness wiU reflect the 
visiom and eharacter of its buUderi, the taachen. Unlike other ediflees, 
however, this one wB never be fmUied. 
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Dissemmationi The Jaigon 
and the Reality 

Ann Lieberman 



Kssfnimation, gfner^y thought of as thf proee^ of spreidrng infor- 
mition, tumi out to b§ m eomplicatid is many institutions that ara 
involved. To get idt as to tate root in diffett nt Wiids of sofl require a 
Imowlidgi of ^eiflc and unique problims inhirant in the powth 

Hiis Aapter exploras some of thase problams as issuas in the dissamini^ 
tion procas^ Theit Issuas indiida: the problam of isolation among tiie 
eduaational constituencies^ tiia atemri searGh for eiQr uiswers to compli- 
cated questions, expactations from rasaarA, languap as a bmier mong 
poups, materia, parsonaUzatlon of Imowledga, tha tendon among 
"loo^ly coupled poupSj" and the Unkar and the linkap proceM. 

l^a Jargon 

Cunent in our educational vocabulaiy is the word "dtasemination*" We 
now have dissantfnation projacts and pressure to diMeminate resaar^ find- 
inp, and most funding aganciei caU for soma form of toamination* The 
assumption is that one e«i take information and spread it among the 
pppulaca» *l^e vaiy tam aMumes a lack of connaetion between the infor* 
mation to be spread and the paople who wo^d ba tha racdvars. There are 
still many who a^ume that one can take a body of ideaSs however weU 
put, and infu^ tham into an orpnization. 

Such a simpliitic viaw of schooling has been ^futed by a growing set of 
studias ravealGig that we are oidy beginning to gat a sense of how the 



iThe issuii railed to tto diiptt t use the Beginning Teiditr Eviliation Study 
(BTES) li 1 ieforfnt» but the intent b to riiit a fetiei of tsiuei on the fenerri topie of 
dimnrii^tion* The luther wai pojeet coordtostor for 1 y tar of a rtitewidB effort to 
Asfimtaiate BtlS results. 
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school works as a social organization (Jackson, 1978; Lortie, 1975) and 
how complicated school improvamant is from both an individual and an 
orpnizational pfrsptctiva (Bennan, 1975; Goodlad, 1975; House, 1974; 
Sarason, 1971). It is important for us to exchange our zeal for instant 
reform of an already beleaguered institution (Liebermanp 1978) to a more 
informed understanding of how ideas aoh^ly get into schools^ how they 
are perceived by various people, and how social and political conditions 
affect the interaction between the two (Farrarj et al., 1978; Mclaughlin 
and Marsli, 1978), 

Isolation of All Groups 

It has become almost a commonplace that teachers in their classrooms 
are isolated from one another and, therefore, are not very trusting of one 
anoiher or of people outside their own immediate workplace. What is 
rnentioned less often is the isolation from one another (and among them* 
selves) of fl^ the constituent groups who have a stake in educating chil- 
dren. Teachers rarely, if evert talk about educational issues with each 
other. Principals and teachers, as well as researchers and developers (Ward 
and Tickunoff, 1975), each talk to their own groups but rarely to the 
group to which they need to relate— both for better communication and 
because the work of these various groups is interconnected. What we have, 
then* are many separate groups all clamoring for better schools and im- 
proved practices, and a notorious lack of mechanisms to connect these 
groups to one another. 

Different expectations from and different perspectives on the educa^ 
tional enterprise are to be expected. But without all the groups attempting 
to understand these diffarances, we have everyone placing blame on some 
ubiquitous enemy. (The enemy changes depending on the group.) 

Example (Disfrict Pifsonngl) 

In one largi districts 1 was askgd to giv§ exMctly the santo ipeech to 
three se^mtg groups. When I asked why we coidd not put them aU 
toiether j I was told that each poup to comfortable .with their own kind 
and would not raise questions the poups were mixed. 

Example (Patents) 

When I spoke to parents, they wanted rc^areh to be able to prescribe 
for the teacher exactly what ha/die should do. When I expUined that 
research helps us better understand the <^mplexlty of teaching, they 
were frustrated at its incompleteness. 

E^mmple (Tea^er-Edu^ton) 

Teacher"educators=-many of whom have seen shifts in the profe^ion 
over the yeatip from developmental con^rni to the important j of the 
dtscipMnei to the three R's-are skeptical of resear^, and rightly so. In 
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om lirgi teadtef tdu^tion fi^ty, the old^ fimdty mtmbe^ nvtaltd 
their cynidsm with the opanseis of the younger ficulty, itiU ftrug^i 
and open for discusdon^ llie rMirdi heini reports wns the vehxde for 
diisu^Qfi^ but it wns deaf that lu^ dkcussioni unong the fioulty 
were few and far betw^n. One fm^ht s^culate that this meeting is not 
atypi^ of other de^xtments of eduction. 

The Seafch for Panaceas 

BTES makes some interesting observations about students' use of time 
in a classroom, teadung ftinctioni, classroom managementi and school^ 
related learning* The research raiies some si^flcant issues about tiie 
workHfe of teasers, Tlie researchers Imow there are many thinp they did 
not look at. Here were choices to be made. ITiose who are told about the 
research hope that anfwers to those hard questions about what teachers do 
and what happens to students ^iU flnaUy be reveded. Itie search for 
simple aniwars to complex quesdons seems continuoi^, 

Resear^ers worMng for a long time refining, thinldng, and struggling 
over their data care very nnuch about clarity, definitions, ^d concepts that 
can be operationally defined. They Jmow that they cannot discribe the 
universe. 

Teachers, on the other handj live daily in tiie maze that researchers are 
attempting to describe. Hey may intuit mudi of what the researchers 
conceptuaBze and categorize. Wien the categories of the researchers match 
the intuitions of the teachers, we begin to get a language and a connection 
between concept and practice. 

What remains problematic is that research is often elei^ted to a position 
of such loftbiess as to be untouchable— or at the other end disreprded as 
**too theoretical." Neither stance ^ows for the hard work necessary in 
understanding teaching and learning Nor does it aUow for pappUng with a 
way of talking about ideas that respects the difflc^ty of goodj clear de- 
scription on the part of the researcher md the myriad number of com- 
plejdties within sMch a teacher o^mtes. No matter how much we wish 
otherv^Hse, complex phenomena will remain complex. 

Lon^Teim Reseaich— A Spadal Problem 

BTES, among other studies, is considered long-term research. In this 
instances the research went on for 6 yean. Such a long passage of time in 
itself raises several issues. 

Because so much time is spent "'doing research," we expect that the 
flntUnp wfll somehow be bigger and better. Again, the hidden life of a 
researcher needs to be revealed to the lay public. We need to toow that 
more time spent on research often means more time to try various 
methodolopes, more time to check out hunches, perhaps more time to 
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look more deeply into a pven aria. It may mean time to think about 
concepts or time to translate what it all means. It may mean time to write 
up observations^ code them, feed them baek, check perceptions. 

StiU another issue s^cific to long-term research is the problem of re- 
search done in one era and delivured in another. This is not an uncommon 
problem. In the case of BTES^ the delivery of the findinp comes at a time 
when the pendulum has shifted to a **back to basics" mood in the country. 
No matter how much one states that the BTES framework is only one 
model arnong several existing ones in a teacher's repertoire, it is being used 
by some as the model, the one and only modeL 

Researchers have often taken the stance that those who read their 
results wUI take out what they want and disregard all the caveats, This 
absolves them from considering the political context within which the 
research is delivered. Educational research, like research on atomic ener^, 
gets used, abused, perhaps distorted. Does the researcher have no respon- 
sibility as to the context within which ideas get placed? Perhaps we need a 
"Committee of Concerned Educators" who will consider and rdse issues 
about the value and use of research within the socld and political arena. 

Relationships between the studier (the researcher) and the studied (in 
this case, the teachers) affect both ^oups and, in the best of circum- 
stances, change both grou^. But these learninp are personal unless they 
become part of the dialog included in the dissemination effort. Such 
dialog, especially in a long-term project, can bs provided for. It may be the 
most important learning for all concerned. 

Dissamination— The Probleni of Language 

Moving from researchers to district office to classroom, one cannot help 
but notice the very sipiiflcant differences in the use of language. It is not 
just that each group of people has its jargon and diortcuts to complexity 
but that the same words have very different si^ificance for different 
groups. 

Example (Mod€!) 

Thi word '*modd" for feseardien mians that they have put togtther 
various concepti to fonn whit app^ari to be a lo^^ set of interrelated 
phinomena. BTE% is in example. 

The wofd **modeP to the field meaiis that we now have an expUdt set 
of ideas that des@riba what the teacher and leamer should do^ This may 
lead, as it dM in saviml instants, to a district astiiig aU teaohers, by 
memOp to innease "^udent time on task^*' 

One might res^nd that the adminlitratofs of this dlstrigt just do not 
understand But it is more mmpUoated than that A field that is as 
un^rtain as tcadting is instantly marching for certalntyj and a model 
speaks to that seardi^ It ap^ars as an organi^d, interrilated, lop^ ^t 
of dimensions ready for use. 
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The fkld Ism thit models do not neosssarily rspressnt aU 
dimendoni of a ph§nominon, and rsseardiers oin learn that there 
are words that M often less definitive ^d more ^mmuni^tive. The 
diffmn^ bitweeii a model and a let of ideas is substuitiaL If researgh 
on teaming and leaming is to be understood and ultiimtely to be of use 
to teadii^, dis^minators muit be sensitive to language and meaning 
buih within and between pou^ 

Materials 

Recent information on school improvement projicti rivtals that mate- 
rials play an important role in helping people open up to new ways of 
thinJdng (Emriok and Pete^on, 1978)* Morag from technieal reports to 
written materials that don't oversimplify the research becomes the central 
problem. Creating attractive materials need not mean that one is miting 
for people who do not read. On the contrary, technical reports have i very 
small and restricted audience. 

Materials on several levels can be created. For example, one may have 
newsletters that excite interest in a project, or issues papers, or critiques. 
Much of this information can be aimed at stimukting dialog If research 
consists of asldng important questions and gatiierlng e^dence to answer 
them, why can^t we also have materials taldng the same inquisitive stan^? 
There wiU always be the tendon between under- and ove^taternent of 
research findinp, but that tension is critical if we ai^ to continue to 
research practical problems in educatioiu 

DissemlnatiDn of R^aarch-- A Ptnonal View 

Often dissemination of research and/or curricular innovations has been 
carried on by materials alone. Over and over apin I was told how impor- 
tant it was to participate in a dialog where ideas could be heard, qu^tions 
could be asked, doubts raised. TeaclierSi administrator, teadier educators, 
and parents lack a forum for the discussion of education^ ideas, a forum 
where one can participate in a supportive atmosphere without being 
graded as in a class, evaluated as part of one's Job, or mandated to per^ 
form. If we are to treat adults as learners (as we would have them treat 
children), we need to Uiink about creating ongoing networks of people 
who can come together to work coUectively at understanding research, 
practice, policy, new laws— all approached in mys that relate pe^onaUy as 
weU 33 professionally (ReynoldSj 1979), 

Educational Constituencies as Loosely Coupled Groups 

Weick's (1976) metaphor of educational organiEations as loosely 
coupled systems expresses weU the problem of dissemination. It is assumed 
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^at i^iyoni in the tducational enterpriia carts primarily that children 
leam and enjoy ichool and that any or aU Ideas that help accomplish tiiis 
end are to be used to improvi schools, M would agree on the large goal, 
yet there are different means to adiieve improvement ^ different vested 
interests, different stakeij different rdes to play and, clearly, different 
expectations of research, pro-ams, and innovations. Jn disseminating the 
major issues of the Binning Teadier Evaluation Study, these differences 
become salient. 

I^ise iisuei m vsry intmiting and important 

Th^ makg me fetl Uki what I am doing ts s tetdier r€gUy matters. 

What do I dp ^th this des^ptlonl 

Yasp I Icnow when the kids ait enpged thiy m learning more. 
How do I keep gnpgement hi^ when I want it? 

(Pringi^) 

l^is is good stuff! 

Do you hav@ any more mattrial? 

I need to uncterstand it bttter. 

My faeulty is riafly ready for thii. 

Do you m% BTCS as a iource for staff deveiopment? 

(District Staff) 

We have b^n looking for a theme, Thu may do it. 
Could you come and speak to our board members? 

(Parents) 

Does this reie^di now gve us a tool for the evalimtion of teaahef s? 

Are you laying that we now know how to teach reading and matii effeetivaly? 

Do^ aoademie leaming time differen^te g^d teaohen from bad? 

(Tea^tF-Edu^to^) 

This is oidy a ^rrelational study , 

I am using this information m my methods dass. 

I don't Uke nor apee with the isiumptions underlying this study. 

How dM they mwure engagemsntl 

At lastp some empiric evidenQe! 

Wfll there poU^ emanating from this study? 

Disseminetion efforts must consider the subtle yet dgniflcant differ^ 
ences between and among these ^oups. ^e teadieri can get information 
and support for their intuitions as they seardi for concrete ideas to aid 
them in the classroom^ as Raquel Mulr described earlier. Some principdSj 
as was cedent in the chapter by Pamala .Noli, look for a set of ideas that 
can serve as an ongoing source for staff development. Using an outside 



^Theie exarnptel ire drawn from a ampling of risponies from hundreds of 
people. 
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resource pirsonj or materials, as a stimulus can be a source for teacher 
self-evaluation. District people are often Goncerned with how to orpnize a 
thrust or a theme around which to hold meetings. Mechanisms to get 
people to work on various projects are often a prime concern. Parents want 
their children to do well in school, Their interest is in how to get the 
teacher and/or the school to provide quality education* They, like 
teachers, are also interested in the concrete and the tan^ble. Tlie chapter 
written by Karen Kepler speaks to the fact that teacher educators care 
very much about the a^umptions underlying research and how it is being 
interpreted. For some, evidence is critical; for others, as Carolyn Denham 
discusses in the next chapteri there is a gromng concern that policy state- 
ments be inferred from research flndings. 

The tension between these groups is based on their different roles and 
commitments to the educational enterprise and explains the loose yet 
important connections between them. 

Tha Linker: A Model?— A Proc^? 

Centr^ to any dissemination effort is the role of a linker: a person who 
moves between groupSs cormecting them where possible, and sensitive to 
their different and varied modes of thinking and understanding. Who these 
people are, how they come to learn their sfciUs, and what they need to 
know has been written about elsewhera (CrandaU, 1977; Uebermani 1977, 
1979). What concerns us here is the central concept of modeling; that is* 
acting upon the kind of behavior that linkage suggests: participation in the 
process of two- way dialog; sensitivity to the group and their expectations; 
involvement with groups at theifleyel of undarstanding; use of many ways 
to engage people in asking questions, giving in forma tioUj becoming in- 
volved. Dissemination of any Hnd of information involves a linker in 
teaching and, therefore, provides a udque opportunity to model these 
behaviors. 

Dissemination as Linkage 

An effective dissemination effort, then, if it is to be more than just a 
cursory listonlng to a 15-minute speech or a fast reading of an article or, as 
the dictionary states, "a scattering of seeds,'* involves people in a complex 
array of knowledge and understandings about: 

L Research, projects, concepts, or whatever it is that is to be dis- 
seminated. 

2. How to talk about the subject to a variety of audienceSj being 
sensitive to their orientation and commitments. 
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3. educational Oeld'i s@arah for panaceas* 

4* Th§ ejcaggerated expectations from a long-term project* 

5, The problem of language as used by different groups that often 
obfuscates rather than iUununates meaning. 

6, Tlie importance of materials, written on several levels^ that in^te 
dialog. 

7, The si^flcanee of personalizing information and identifying 
^th the particular of an audience. 

8, TTie political impUcationi of research to different poupi, 

9, Modeling the type of interactive behavior that ^aractarizes 
teaching and learning. 

Dissemination, rather than the simple notion of spreading information^ is a 
complicated process that cdls for understanding and acting on peiional, 
organi^tiond, and political knowledge (Schiffer, 1978) and an interaction 
of many persons and organiEations. It is not just spreading seeds but 
hdping them take root. The process is connected to our pov^ng under- 
standing of how ideas get into a system, how they are nurtured, and how 
they pow. 
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A mijor contribution of the Bapming Taacher EvdiiatiQn Study is the 
notion of miaBuring liiming as it oceurs, without wdting for achiavemint 
tests, Tlie finding that Academic Learning Tima eorrelatee ^th adiievi- 
mint test scores is of taterest not only becausi it remlndi us that time b 
important in liarmn^ but bicause it gives us hope that w© may soon have 
a me^uri of ongoing learning a\^able for iviryday use by teachers in the 
classroom. In miantime, tihi study pves teadiera support for using 
tiieir own observations m a^ssing their students* process rattier than 
relying excludvely on test results. 

The notion of miisuring liamlng as a process rather than a product is 
an attractive one. As in eriterion-referinced testing and mastery learningi 
students ar^ not compared on tfie amount of materid learned. ALT, how- 
ever* is m even more powerful equalizer: students bepn as equds at the 
start of each learning period and, at end of the period, they are 
diffarenttoted only on the amount of time they have spent learning. In 
criterion-referenced testing and mastery leaminis thire remains the po^i- 
bflity of comparing students on the number of tasks mastered and tiie 
i^peed of maiten^. Measurements of ALT do not pro^de the opportunity 
for such comparisons. FurUiermore, measurti of ALT do not discourage 
the teacher from proceeding with tfie introduction of the next task to 
faster learners whfle slower ones remain on unflnished tasks. In mastery 
leamingj witii its empharis on masteo^ for almost everyone, some teachers 
Me tempted to keep faster students occupied with less important activities 
whUe slower students complete taste aheady mastered by faster ones* 

It would be premature Mid perhaps inappropriate to suggest that ALT 
could replace achieviment testing in certain situations. Yet there are sipis 



The author strvid is chainnin of the raseMgh committee of the Cal^omia 
^mmiidon on Teacher Pjeparition and Licensing durinf much of its work on BTES, 

Oules Fisher and Gary F^it«imi*er pro^did helpful commints on an euUer 
vefdon of thii paper. 
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that tgachere ai weU as itudents may benefit by the notion of Academic 
Learning Time. Teacheri have reported to my colleagues that they felt less 
threatened when held accountable for either ALT or engaged time than 
when held accountable for test scores or masteo^ levels* Furtherj teachers 
have reported to me their sattefaction at receiidng immediate feedback on 
their efforts throu^ attention to either ALT or engaged time* 

Mother important contribution of BTES is its careful definition of 
ALT, which ipeciflei that learning includes more than engagament on a 
task-the student success level and academic content of the task must be 
appropriate. As a result, increasing ALT is not simply a matter of keeping 
students busy. Indeed, tiie ALT definition illuminates the complexity of 
teaching and the need for a variity of approaches. 

It is often said that teaching is an art. Wiether the teacher must be an 
artist or just a very good manager is unclear. But the BTES flndings imply 
tiiat there is a large role for the creativity and Judpnent of the teacher. 
Hiey demonstrate the need for attention to the lometimes conflicting 
demands of student success and student mgagement, and the potential 
conflict between student success and reievanae of academic material. At 
present there is no substitute for teacher judgment in determining how 
best to address these potentially conflicting variables, 

Attempts to maximize both student engagement and student success 
are complicated by the BTES finding that activities tending to increase 
engagement, such as whole-class instruction, may not be the best way to 
provide students vdth tasks of appropriate difficulty. On the other hand, 
individualized progrMnsj with their emphasis on appropriateness of instruc- 
tional content and pacings may maximize success rate but lead to lower 
engapment rates (Fisher et al., 1978* 4142). 

Similarly, attempts to maintain student success rates must be 
tempered by attention to the relevance of tfie academic material. Once a 
student has had sufficient successful practice on a taskj new material must 
be introduced to keep the aMdemic materials **«levant." The introduction 
of new material may lower the student's rate of success or, at leasts the 
teacher may have to take extra measures to keep students at a hi^ success 
rate while introducing new material. Unfortunatelyj the tension between 
success rate and relevance is not emphasized in reports of the study, with 
the resulting danger that some may interpret BTES as supporting the use 
of drills and otiier exercises* regardless of content coverage. Before Aca- 
demic Learning ^me can serve as an adequate surropte for achievement^ 
much work must be done to determine how much time ^ould be spent at 
high success rates and how quickly new material should be introduced. In 
tfie meantime, the BTES pro\ddes i mch for the poli^maker to consider: 

(1) the importance of allocated time, enpged time, and success rate; 

(2) the checklist of necessary teaching functions such as dia^osis ^d 
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priiantition; and (3) the Inipact of dassroom dtuations suoh as large 
VBTBUB man^group instruction and emphisis on affect ^^us amphasis on 
isadimio work. 



Using the Study for Policy 

Ilia BTES was conducted for the purpoia of diaping educational 
poUcy. The above ^scu^on suggeits that itudents and teachers may 
binefit from Ae notion of Academic Le^lng Time, But what about 
poUcymakeii? Spceiflcdlys the educational poU^makers considered here 
are schod admlnistratori, school board members, leglslatoris members of 
Fiderdi State, and lood offloas or departments of education, and, flnaUy, 
the members of Uie California Commi^ion for Teacher Preparation and 
Uceni^ngs the agency serving u prime contractor for the study. 



The Problem With Mandates 

First it must bi understood that the Be^nnini Teadier Evduation 
Study is not a study of teacher evduation. The myste^ of its title may be 
explained by an examination of the Wstoty of Ae project (see the dis- 
cussion by Powell in ttie introductory section of this book). The list of 
teadung functions and the measures of AcidenMC learning Time may be 
hdpful for working with teadien for improvementj but ^sessment of a 
teacher on these functions or on ALT for such purposes as rewardSj 
tenure, or ciedenti^ing is not appropriate at this time. The reasoni for this 
diould become clear as we examine the l^ger question: if teadier 
beha\dors are related to ALT, which in turn is leiated to achie^ment, can 
education^ policymaker inerease student achieviment by simply re- 
quiring teadiers to behave in certain ways or by requiring increases in 
dlocated time, engaged time, or Academic Learning Time? 

My answer Is that policymakers cannot expect to raise students^ 
achievement throu^ such mandates. First, the BTES findings cannot as- 
sure policymakers that the changes in teacher beha^ois or student learning 
time examined by the BTES actually bring about improved achievement. 
The BTES shares witii other studies in tiie social sdances a tendency to 
produce results that wa tentative and incomplete. Cohen and Weiss (1977) 
go so far as to argue that improved research does not lead to greater 
consensus but to more complex and diverse resdts and to technical argu- 
ments among researchers. Kepler, in an earlier chapter, indicates some of 
the questions that may be mised about BTES results. 

Second, the principles resulting from the BTES may not be applicable 
to students or situations unlike those exantfned by the BTES; namely^ 
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riid^g and math instruetion of iicond and flfth gradars who are niither 
Viry tdfii nor vtiy low achJivara, 

lUrd, ^though the study rsports p^tive rilation^p bitwaen 
aphis^nnent and both aUocatid and engagid time, Rosenahinip in his 
ehaptar on school time, exiunines some of tha difflaiUties in inoreEsing 
learning tima. ^e way to increw located time for academias would be 
to decrfisa time for "nonaaademic" subjeoti lueh as art, musiCj and 
phyiiQd eduoation. Biit Rosenddne points out tfiat many educators would 
find this option unsatisfaatory, and pirhaps righUy so^ Aeaording to 
Ro^nshinep it would ako be difficult to increase acadamic time by re- 
ducing noninstructional time, much of which is made necessary by the 
diversity of school activities. For axample, the majority of noninitruc- 
tiond time is spent in "transitions," such as going to and from lunch and 
recess. Evan within allocated time, a certain amount of nonangaged time 
seems to be necessary and desirable. It takes time to distribute and collect 
boola and papei^, and, even in the most effldent classroomi, students 
son^times wait for help, corrections, and mstructions. Rosenshine suggests 
that such acti^ties are made necessary by large classes and diverse 
students^ 

Hius, it may be difRcult to find more time for academics within Uie 
present schoolday. Hie effects of lengthening the schoolday were not 
examinad by the BTES. ^thou^ incraasing aUocatad time within the 
limits of the study brought about inc^ases in enpgement, the study does 
not tell us whether it would be productive or counterproductive to 
lengthan the schoolday. 

Another reason it is likely to be difflcult for policymakers to affect 
unprovements throu^ mandates based on the BTES, is that it is not 
possible to taU a teacher exactly what to do to implement BTES findinp. 
Tha teacher beha^ors isolated in the BiES a^ not discrete ictivities 
which may be demonstrated and copied. They are funcdons such m pre^ 
santation and monitoring which may be fulfilled in any number of ways, 
dapending on the teaching situation. Th.^ taachar, rather than the poUcy^ 
maker, is in the bast portion to select activities to MfM these funqtions, 
basing the choices on the immediate classroom situation and adjusting the 
activities m the dtuation in the classroom changeSi Although there are 
soma ongoing projects using BTES flndinp in staff development (e.g,, 
Fi^er and MarUava, 197S)p at present there is little to help the policy^ 
make^ explain how a teacher could implement BTES ideas. 

FinaBy, avan if the study were to pve policymaken aU of the answers 
about effective te^hin^ poU^makers co^d not be sure that mandates 
ba^d on the study would be affectiye. In Henry IVt Part I ^ Glendower 
brspi 

I m ^1 ^iriti from the vaity d§ep. 
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Hotspur ripliei: 

Wh^i so msi h ot so mi any niin; 

But wiU tiliy Qom^ when you do @U for diem? 

bidmdi the edueation^ poUojmnikar U in a similar podtion ^th rilpact 
to cDmpUanaa vMi manditii. bnportwt studiii of educational ehanp, 
moh as thi Rimd Corporation study of Ftdiral Fropams Supporting Edu^ 
cttioiml Aanp CBirmui and MoIiiU|jilin, 1975), sugpit that sucgassftd 
implimintatlon of innoi^tioni oosun only when a s^hoors fae^ty and 
staff minibers diari In the diolsions affecting themj when th@y davilop a 
feeling of omirddp of tiie buiovation, and whin ^ey are dlowed to 
adapt it to their own dtuation. 

Any mandates by poUeyniakers may be flowed inyoluntarily} maUng 
it leis likely that the risulting diuigis have tto mm po^tive effects as the 
voluntary actions of the teadiers in the BT^ sample. For example^ let us 
conrider the posribOity of mandates based on the oomponenti of Aea- 
demio Learning Time.' dloaated thni» engaged times and lueeiis rate. Mm* 
dating ingreases in located time would not gumntee that students would 
spend the time worldng attentively on appropriate materials. The time 
ndght be allocated^ but teachers ndght not make the necessary effort to 
keep the students enpged. But even if teachers ware required to increase 
enpgad timet students mi^t not ba enpged in t^ks of a^ropriata diffl- 
culty. Indaad, mandates to increase enpged time mi^t increa^ the posd^ 
bflity tiiat students would be given Inappropriate taskst for a teacher mi^t 
be temptad to u^ whole^la^ instruction to ma^miia enpgement^ al^ 
though tlus practice could result in many studenti worldng on tasks of 
inappropriate difficulty* 

Ihus, nalther mandates to incraasa allocated time nor mandates to 
increase engaged time may be gturanteed to have beneflcid effects. Pur^ 
tiier, tha BTES doas not provide enou^ inforniation on whidi to base 
mandates of success rata. Although Ae resdts indicate that students 
would baneflt by spen^g mora time at a hi^ rate of sucoaii than they 
typicaUy do, the reitdts are not dannltive enough to prascribi rates of 
success to be mEndated. Here we mi^t continue to raly on ^e judpient of 
the Informed teacher to interpret and adapt the flndinp* 

Sncouragemmi and Assistance From Policymakers 

Rather than ddivering mandates, an ^tenutlve courie for policymakers 
wishing to make usa of the BTES inforniation is to ^are the ideaSt encour^ 
age thair use, md a^st those who attempt to make their own changes. In 
precading chaptaii, Fenstemiacher» Miller^ and WflUams argue that 
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teichirs are not to be told exactly what to do but are to be pven the 
infonnation and asaistPJiee necessary to make their ovm improvements* 

Hie role of sharing and asdsting is a role the Califomia Commiision for 
Teaeher Preparation and Lieenslng is foUowing in its handling of the BTES 
results. When it conceived the study, it hoped that the study would help it 
write mandates, or "guidelirtes," for schools of education to follow in 
training teichem It appears that the commission has abandoned these 
hopes (Denham, 1979), Instead, it has begun a program of dissemination 
through newsletters, pubUcatlonSj and conferences and a program of asste- 
tance throu^ small p^ants for trying out BTES ideas in schools or uni» 
varsities. 

Federal, State, and local educational policymekers could take on the 
role of encouragement and assistance throu^ such acti^ties as the 
following: 

L Drastically reduce the iiu of cksses. 

Glass and Smith (1978, p, 46) stated that there is "little doubt" that 
"more is Uamed in smaller classes/* Based on an exhaustive study of data 
on nearly^900,000 students, they concluded that student achievement 
increases as class size decreases, particularly when the class size goes below 
20 pupils. 

The BTES may provide us some of the reasons for this phenomenon. 
Fisher and his colleagues (1978, p. 15) report that more substantive inter- 
action between the student and an instructor is associated with higher 
levels of student engagement. Substantive interaction consists of pie- 
senting information^ monitoring work^ and p^ng feedback* It may be that 
it is possible for teachers to provide more substantive interaction in smaller 
classes, C^an and FUby (1979) are conducting a study to ditermine 
aspects of instruction in smaller classes which account for the achievement 
advantages.^ Reducing claM size is, of course, a very expensive option, but 
there may be instances in which the benefits would be well worth the 
expense, 

2, Provide sideh parent voluntesn, and tutors, 

ThiB action should help teachers increase the amount of substantive 
interaction and, presumably, increase engagement rates. 

^tiiou^ engagement rates are higher in group work than in seatwork, 
in which the student works alone, if a teacher ware to use whole-class 
instruction all of the time, the pace would be too slow for some and too 



Inie work is beini Gonducted under a pint (No, from the 

Nitional Institute of Edu^tloiL The report by Glass and Smith (1978) was produeed 
under thU pint, for whidi Cahen and Fflby are ft'oject Directors. 
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fast for othi^. In the typical ^oond^ or flfth-jradi dassroomj much timi 
h ipint vdtii students divldid mto tlu'ic poups« SiAci the tiadiir can 
work wltii only oni poup at a tbiiiy aideSp vduntien, or tuto^ could hilp 
itudints hi thi otiiar poups» providing substwtive intiraction md, pr§^ 
sumably» IncriaMng eng^ment ratts. It stems reasonable to bilievi that 
dasirorai hdpers with loma training could perform many of the tasks of 
mmitoring uid feedbacks Provided they toew the answers to the problems 
on which students are worldng^ ^ey could go from student to student 
monitoring work and pro^dhig feedback. Ihie relationship of academic 
feedback to achievement is one of the strongest in the study. Of courset 
ddes would have to be oaref^y selectedi adequately trainidj and suited to 
tfie conditions and needs of the cla^room in which they were placed, 

A visitor to a typ^al sdiool nu^t noUM many thinp happening be^ 
ddes instruction. Thari are announ^ments, telephone cdls, forms to com^ 
plitit reports to make» and in^vidud students cdled out of da^rooms, 
TMi is due in part to locd procedurest but Statt uid fedei^y toded 
programs hav& added to the number of dist^ctioni (Acland and Deidiamj 
1979% The BTES emphasis on effldent use of time wUs our attendon to 
tfie problems of repeated in^miptions, 

4. Support tmbtin^ far Mdiwn md t§adt€r aandUaM 

The BTES sugpsts that there are many Map for teadim to learn: 
how to manap tune} measure Academic Ijeaming Time, reduce inddents 
of inappropriate student behavior^ and perform the necessary teaching 
ftmctions. The cooperative trab^g propun described by Miller in an 
earlier chapter su^e^s wa^ to proidde this tramin^ 

5, E^^^ore ^§ me of A^dsnUe LmmUtg Time m indicstor of 
eqi^ify ofsd^^tioml opp^tmityt 

Defining equality in terms of equal education^ resources ipores the 
fact that some students need special assistwce. Defining equdity in terms 
of equ^ achievement outcomes places an slmost unposslble burden on 
education^ Institutions. EquaUty of Academic Ijaming Time fidls some- 
where between toe otfier two definitions tod may be a practicd and 
deMrable goal. 

The BTES suggests that students could benefit from spending more 
time on tasta at which they are suscessful. Positive effects of hi^ success 
rat^ were e^bited in attitudes as weU as In achievement. 
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PoUcymtka^ must, of coum, condder the miny funeUons of sdiooli, 
among them thi fuhction of catigorizing md selecting studints. Howevifp 
undua attention to the selection function may deprive some studenti of 
lufflcient successfld axperien^s. 

Findly, poUQmiakeri could probably encourage others to conilder 
BTES ideas by u^g some of the ideas in their omi dedslons and reports 
of the^ decisions. For example, policymaton tempted to add new respon- 
dbUitiis to the schools rai^t conader how new responsibilities might 
affect time ai^able for the current propam. In addition, many decisions 
hi education would >1eld to an analysis of how allocated and enpged time 
would be affected-tiie lengA of cla^ periods, class size, and transporta- 
tion, for example. 

Summiry 

At a time when "back-to-basics'* is popular, there is a danger that Ae 
BTES may be misunderstood, y/hm the casual reader of the reports thinks 
of ALT, he or she mi^t think of strai^t row of desks and long periods 
spent in academic drills. But BTES researchen argue that BTES Ideas can 
be used in da^rooms with different educational philosophies and goals. It 
would be unfortunate if policymakers moved too quicldy toward man- 
dates based on BTES, The potential benefits of the BTES lie not in 
mandates by policymaker but in the extent to which It leads to increased 
understanding by those involved in education, 

ihe study brings us eneoura^g news. Popular interpretations of the 
Coleman report (Coleman et al., 1966) left the impresrion that sdiools and 
teachers are unimportant. The BTES brinp us the encourapng message 
that teacher time md student time are important and that, by implication, 
both teachers and students are important. In Aort, the teabhers need time 
to teach and the studenti need time to leam. The BTES, ^th its Academic 
Learning Time concept, ^ves us a way of thinldng about and observing the 
amount of learning that is occurring. 
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